W2 Sr. Cloud Data Integration Engineer – IICS CDI AWS PySpark Python(Hybrid)

W2 Sr. Cloud Data Integration Engineer IICS CDI / AWS / PySpark / Python

Location: McLean VA (Hybrid)
Interview: Video
Experience: 8 Yeara

ABOUT THE ROLE

We are seeking a Senior Cloud Data Integration Engineer with deep hands-on expertise in Informatica Intelligent Cloud Services Cloud Data Integration (IICS CDI) to join a high-impact data engineering team. The ideal candidate brings strong experience designing building and optimizing enterprise-grade data pipelines on cloud platforms with solid proficiency in AWS PySpark and Python. This role is central to enabling scalable governed data movement and transformation across complex enterprise environments.

IICS CDI refers to Informatica Intelligent Cloud Services Cloud Data Integration a cloud-native ETL/ELT and data integration platform used for building and orchestrating data pipelines across cloud and on-premise sources.

KEY RESPONSIBILITIES

• Design develop and maintain end-to-end data integration pipelines using IICS CDI (Informatica Intelligent Cloud Services Cloud Data Integration)
• Build and manage mappings mapping tasks taskflows and orchestration workflows within IICS CDI
• Develop and optimize data ingestion transformation and loading pipelines across structured semi-structured and unstructured data sources
• Integrate data from diverse sources including relational databases flat files APIs cloud storage and SaaS applications into target systems
• Build and maintain PySpark-based data transformation pipelines for large-scale distributed data processing
• Write Python scripts for data automation pipeline orchestration data validation and utility development
• Leverage AWS services including S3 Glue Lambda Redshift RDS EMR and Step Functions for cloud-based data engineering workflows
• Implement CDC (Change Data Capture) patterns and incremental load strategies within IICS CDI pipelines
• Collaborate with data architects business analysts and downstream consumers to understand requirements and translate them into scalable integration solutions
• Monitor troubleshoot and optimize pipeline performance identifying and resolving bottlenecks
• Implement data quality checks validation rules and exception handling within integration pipelines
• Maintain technical documentation including data flow diagrams mapping specifications and pipeline runbooks
• Participate in code reviews CI/CD pipeline integration and deployment across dev test and production environments
• Ensure data security compliance and governance standards are maintained across all integration workflows

REQUIRED QUALIFICATIONS

• 8 years of overall experience in data integration and data engineering
• 5 years of hands-on experience with Informatica IICS CDI including mappings taskflows connectors runtime environments and Secure Agent configuration
• Strong experience with AWS cloud services: S3 Glue Redshift Lambda EMR Step Functions IAM and CloudWatch
• Proficiency in PySpark for distributed data transformation and large-scale data processing
• Solid Python programming skills for scripting automation and pipeline support
• Strong SQL skills for data validation transformation logic and backend querying
• Experience with CDC patterns incremental loading and real-time or near-real-time data integration
• Familiarity with REST API integration and web service-based data extraction within IICS
• Experience with version control tools: Git Bitbucket or GitHub
• Strong understanding of data warehousing concepts dimensional modeling and ETL/ELT best practices
• Excellent problem-solving communication and cross-functional collaboration skills

PREFERRED QUALIFICATIONS

• Experience with Informatica MDM IDMC or CAI (Cloud Application Integration) in addition to CDI
• Familiarity with Snowflake or Redshift as target data warehouse platforms
• Experience with Apache Airflow or AWS Step Functions for pipeline orchestration
• Knowledge of data governance lineage tracking and metadata management
• Exposure to Agile/Scrum delivery methodologies
• Informatica or AWS cloud certifications are a plus