Applications Developer - ETL/Pyspark - Assistant Vice President

We are seeking an enthusiastic, detail-oriented ETL Developer to join our data engineering team. In this role, you will be designing, developing, and maintaining scalable data pipelines using **PySpark**, **Talend**, and **Ab Initio**. You will work closely with senior developers to transform raw data into valuable business insights, ensuring optimal data quality and performance - **ETL Pipeline Development:** Building and maintaining Extraction, Transformation, and Loading (ETL) workflows - **Big Data Processing:** Utilize PySpark for data processing, manipulation, and analysis within big data ecosystems. - **Data Extraction & Ingestion:** Extract data from multiple sources including relational databases (SQL), flat files etc. - **Data Transformation:** Create mapping documents and apply business logic to transform large datasets. - **Performance Tuning:** Assist in analyzing and optimizing existing ETL jobs and Spark scripts for better scalability and execution speed. - **Testing & Documentation:** Perform unit testing, validate data accuracy, and maintain technical documentation for all ETL processes. - **Production Support:** Help monitor scheduled daily/weekly jobs and troubleshoot data integration or quality issues **Recommended Qualifications:** - 8-10 years of relevant experience - Experience in systems analysis and programming of software applications - **Programming Languages:** Proficiency in **Pyspark** and **SQL**. - **Big Data Frameworks:** Hands-on experience or strong conceptual understanding of **PySpark**. - **ETL Tools:** Familiarity with Data Integration/Big Data tools and **Ab Initio** components. - **Scripting:** Basic to intermediate knowledge of **Unix/Linux Shell Scripting**. - **Databases:** Understanding of Big Data (Hadoop) & RDBMS like Oracle, or PostgreSQL - Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements **Education:** - Bachelor’s degree/University degree or equivalent experience This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required. ------------------------------------------------------ ## **Job Family Group:** Technology ------------------------------------------------------ ## **Job Family:** Applications Development ------------------------------------------------------ ## **Time Type:** Full time ------------------------------------------------------ ## **Most Relevant Skills** Please see the requirements listed above. ------------------------------------------------------ ## **Other Relevant Skills** For complementary skills, please see above and/or contact the recruiter. ------------------------------------------------------ *Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.* *If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review* *[Accessibility at Citi](https://www.citigroup.com/citi/accessibility/application-accessibility.htm).* *View Citi’s [EEO Policy Statement](https://www.citigroup.com/global/eeo-aa-policy) and the [Know Your Rights](https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) poster.*