AI Research Scientist- Multimodal Foundational Models

## Company Description The Bosch Research and Technology Center North America with offices in Sunnyvale, California, Pittsburgh, Pennsylvania, and Cambridge, Massachusetts is a part of the global Bosch Group (www.bosch.com), a company with over 70 billion euro revenue, 400,000 employees worldwide, a very diverse product portfolio, and a history spanning over 125 years. The Research and Technology Center North America (RTC-NA) is dedicated to providing technologies and system solutions for various Bosch business fields, primarily in the field of artificial intelligence, energy technologies, internet technologies, circuit design, semiconductors and wireless, as well as advanced MEMS design. As a part of the global research, our AI research in Silicon Valley focuses on Foundation Models, Natural Language Processing, Computer Vision & Mixed Reality, Cloud Robotics, Big Data Visual Analytics, Explainable AI (XAI), Data Science, AI System Engineering, Time-series Analysis. We develop scalable, intelligent, and trustworthy AIoT solutions for Bosch products and services in application areas such as automated driving, advanced driver assistance systems (ADAS), robotics, smart manufacturing, enterprise AI, health care, smart home and building solutions. Originating from the AI research in Silicon Valley, our **Foundation Model Powered AI Enablers** group plays a pivotal role in shaping the future of industrial AI experiences for Bosch products and services. By fusing cutting-edge machine learning, data analysis, and interactive visualization technologies, we research and develop scalable and transparent AI & big data analytic solutions (e.g., audio, images, sensor logs) for a range of domains, including Industry 4.0 (I4.0), IoT, autonomous driving, and connected vehicles. Our award-winning team (IEEE VIS best paper & best paper runner-ups) actively collaborates with leading academic and industry groups to advance research ideas and disseminate findings in top AI conferences and journals, such as CVPR, ICCV, ICRA, ECCV, NeurIPS, ICLR, SIGGRAPH, TVCG. ## Job Description **Job Responsibilites:** - Develop and lead research of AI projects that label, predict, classify, cluster, describe and fuse multi-sensor data (including acoustic, telemetry timeseries signals, vibration, radar, lidar, image, Wi-Fi, and ultrasound data), to improve / enable advance driver assistance system (ADAS) functionality in vehicles and AI functionalities in other Bosch products. - Architect, design and validate multi-modal deep learning and Timeseries Foundation Models (TSFM) to work with multivariate time series signals. - Integrate and extend timeseries models to leverage information from other auxiliary modalities such as videos and images to enhance context understanding. - Offer expert insights to the management team in relevant technology sectors, aiding in strategic planning, R&D trajectory, and investment decisions. - Stay abreast of the latest technological innovations, document and disseminate research findings through high-caliber publications and/or patent submissions. ## Qualifications **Basic Qualifications** - Ph.D. in Computer Science, Electrical Engineering, Information Technology or a related discipline OR Masters degree with 2-3 years of preferred professional experience - Expertise with Time Series FMs (beyond the time series task of forecasting) - In-depth experience in signal processing for sensor data and their integration with deep-learning methods - Proficiency in Python, PyTorch (including libraries such as torchaudio, torchvision, torchmetrics), familiarity with PyTorch Lightning - A strong publication record in relevant venues such as ICASSP, NeurIPS, InterSpeech, ICML, ICLR, KDD, ICRA, CVPR, ICCV, ECCV or equivalent contributions to the field such as patents or significant open-source projects - Strong interpersonal, communication, and teamwork capabilities **Preferred Qualifications** - 3+ years of experience in industrial research -…