Data Scientist- VLM (Vision Language Model) Job at Capgemini Engineering, Waukesha, WI

czdsMHhOaHk2L0s4RldWd1ptUUxWMGVmalE9PQ==
  • Capgemini Engineering
  • Waukesha, WI

Job Description

About the job you’re considering

We are seeking a highly skilled and detail-oriented Vision-Language Models (VLM) Data Scientist/ Vision Data Analyst to join our team. The ideal candidate will have a strong background in computer vision, natural language processing, data analysis, and machine learning.This role involves developing and deploying multimodal AI solutions that integrate vision and language capabilities, analyzing visual data to extract meaningful insights, and collaborating with cross-functional teams to improve our products and services.

Your role

  • · VLM Development & Deployment: Design, train, and deploy efficient Vision-Language Models (e.g., VILA) for multimodal applications. Explore cost-effective methods such as knowledge distillation, modal-adaptive pruning, and LoRA fine-tuning to optimize training and inference.
  • · Multimodal AI Solutions: Develop solutions that integrate vision and language capabilities for applications like image-text matching, visual question answering (VQA), and document data extraction. Leverage interleaved image-text datasets and advanced techniques (e.g., cross-attention layers) to enhance model performance.
  • · Healthcare Domain Expertise: Apply VLMs to healthcare-specific use cases such as medical imaging analysis, position detection, motion detection, and measurements. Ensure compliance with healthcare standards while handling sensitive data.
  • · Efficiency Optimization: Evaluate trade-offs between model size, performance, and cost using techniques like elastic visual encoders or lightweight architectures. Benchmark different VLMs (e.g., GPT-4V, Claude 3.5) for accuracy, speed, and cost-effectiveness on specific tasks.
  • · Data Analysis: Analyze large sets of visual data to identify patterns, trends, and anomalies.
  • Algorithm Development: Develop and implement computer vision algorithms to process and interpret visual data.
  • · Machine Learning: Apply machine learning techniques to improve the accuracy and efficiency of vision-based systems.
  • · Reporting: Create detailed reports and visualizations to communicate findings to both technical and non-technical audiences.

Your skills and experience

  • · Education: Master's or Ph.D. in Computer Science, Data Science, Machine Learning, Electrical Engineering, or a related field.
  • · Experience: 3+ years of experience in machine learning or data science roles with a focus on vision-language models and computer vision. Proven expertise in deploying production-grade multimodal AI solutions.
  • · Technical Skills: Proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow). Hands-on experience with VLMs such as VILA, or VSS. Strong understanding of image processing techniques and tools.
  • · Analytical Skills: Excellent problem-solving skills and the ability to analyze complex data sets.
  • Communication: Strong written and verbal communication skills. Ability to present complex information clearly and concisely.
  • · Teamwork: Ability to work effectively in a collaborative team environment.
  • · Experience with cloud computing platforms such as AWS or Azure.
  • · Familiarity with data visualization tools like Tableau or Power BI. Knowledge of statistical analysis and data mining techniques.

Job Tags

Similar Jobs

Onward Search

Corporate Communications Copywriter [78437] Job at Onward Search

 ...role is located in Miami, FL! Responsibilities: Youll write craft high-quality internal email communications, executive...  ...event communications (digital and print) ~ Perks & Benefits: Medical, Dental, and Vision Insurance ~ Life Insurance ~401k Program... 

HCA St. David's Healthcare

staff - Registered Nurse (RN) - Nurse Extern - $16-21 per hour Job at HCA St. David's Healthcare

 ...HCA St. David's Healthcare is seeking a Registered Nurse (RN) Nurse Extern for a nursing job in Georgetown, Texas. Job Description & Requirements...  ...St. David's Healthcare Job ID #1-INFOR-3218560-OTHLOC-25067. Posted job title: Nurse Extern for St David's HealthCare... 

ACL Digital

Liaison Engineer Job at ACL Digital

 ...Role: Liaison Engineer / MRB Engineer Location: San Antonio, TX Type: Contract Duration: Long Term Skills: ~5+ years of experience with the design of structural and electrical rework/repairs to restore the aircraft or system to original design capability.... 

QualiCare Maids

P/T Cleaning Jobs in Charlotte NC Trabajos de limpieza P / T Job at QualiCare Maids

 ...out a job application at: Apply with Get.It ONLY SERIOUS JOB APPLICANTS NEED APPLY THAT FIT ALL OF THE ABOVE QUALIFICATIONS. Trabajos de limpieza a tiempo parcial en Charlotte NC Trabajos de limpieza a tiempo parcial en Charlotte NC para latinas con experiencia... 

Atzenhoffer Group

Office Helper - Summer Internship Job at Atzenhoffer Group

Job Title: Office Helper - Summer Internship (Paid, Flexible Hours, Potential for Extension)Position Type: Paid Internship - Part-Time (Minimum 12 hours/week)Description:We are seeking a reliable and detail-oriented Office Helper Intern to support our Accounting...