Big Data Developer

Big Data Developer

Location: Plano TX (Hybrid) 3 days onsite a week

Duration: 10 months with possible extension

IV: 45 min zoom video

Initiatives:

Design and enhance data pipelines leveraging Python TypeScript and SQL to support enterprise-scale data processing and analytics.

Develop and maintain data dashboards and reporting solutions to deliver actionable insights to technical and business stakeholders.

Optimize and modernize existing data pipeline architecture ensuring improved performance reliability and scalability.

Utilize Snowflake as the primary data warehousing platform including data modeling query optimization and pipeline integration.

Support real-time data streaming initiatives using Kafka as the core messaging and event-streaming platform.

Work with AWS-based infrastructure including Kubernetes for container orchestration AWS Lambda (Python-based) for serverless data processing RDS for database services and S3 for data storage.

Execute data analysis and SQL-driven validation to ensure data quality completeness and accuracy across pipeline outputs.

Collaborate with engineering and product teams to translate business requirements into scalable maintainable technical solutions.

Contribute to system reliability and operational excellence through monitoring testing and process automation.

Key Terms on Resume: Python AWS Hive Kafka SQL TypeScript Snowflake NoSQL MapReduce EMR.

Tech Must Haves ------

8 years experience as Senior Data Engineer

Hands on Experience developing data pipelines or applications using Python or TypeScript and SQL.

Someone strong in Python or TypeScript

Experience working with real-time data streaming platforms using Kafka.

AWS Cloud services experience (e.g. EMR Redshift Lambda S3 ECS/EKS) and distributed computing tools including Spark Hadoop Hive MapReduce and EMR.

Experience with data warehousing solutions using Snowflake.

Experience in Agile/Scrum engineering environments.

Job Description ------

In this role you will design build and optimize data pipelines and applications that support large-scale real-time and batch data processing across the enterprise. Youll work with modern cloud technologies distributed systems and agile engineering practices to deliver high-performance scalable data solutions that power business decisions and digital experiences.

Youll partner closely with product owners data scientists platform engineers and business stakeholders to transform complex data into actionable insights while ensuring reliability performance and security across the data ecosystem.

Key Responsibilities

Design build and maintain scalable data pipelines applications and services using Python SQL Typescript or Java.

Develop and support real-time data streaming solutions using technologies such as Kafka Flink or similar tools.

Utilize AWS cloud services (e.g. EMR Redshift Lambda S3 ECS/EKS) and distributed computing tools including Spark Hadoop Hive MapReduce and EMR.

Implement and optimize NoSQL data stores such as MongoDB or Cassandra for high-velocity large-volume workloads.

Build and manage data warehouse and analytical environments including Redshift Snowflake or related platforms.

Work within Linux/UNIX environments applying shell scripting and command-line tools for automation and system operations.

Collaborate in an Agile environment-participating in sprint planning retrospectives code reviews and daily standups.

Ensure data quality system reliability and performance through testing monitoring and best-practice engineering patterns.

Troubleshoot production issues optimize pipelines and contribute to continuous improvement across data platforms.

Basic Qualifications

Hands-on experience developing data pipelines or applications using Python SQL Typescript or Java.

Practical experience with AWS services and at least one distributed computing tool (Spark Hadoop EMR Hive MapReduce Kafka etc.).

Experience working with real-time data streaming platforms such as Kafka Flink or similar technologies.

Expertise with NoSQL technologies (MongoDB Cassandra etc.).

Experience with data warehousing solutions (Redshift Snowflake).

Strong foundation in UNIX/Linux environments with shell scripting and basic command-line utilities.

Experience in Agile/Scrum engineering environments.

Preferred Qualifications

Experience working in a large enterprise financial services or cloud-native environment.

Familiarity with CI/CD pipelines DevOps toolchains and automated testing frameworks.

Exposure to machine learning pipelines feature engineering or optimization engines such as Gurobi.

Strong problem-solving debugging and analytical skills.

Excellent communication and collaboration skills with the ability to influence across teams.

Thanks

Amaresh

Sr. Technical Recruiter

Momento USA Exceeding Customer Expectations

440 Benigno Blvd Unit#A 2nd Floor. Bellmawr NJ 08031

Interstate Business Park

Direct : Ext (1022)

Email:

Are You LinkedIn:

Minority Certified by SWAM
National Minority Certified by NMSDC

Information transmitted by this e-mail is proprietary to Momento USA and/ or its Customers and is intended for use only by the individual or entity to which it is addressed and may contain information that is privileged confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this mail has been forwarded to you without proper authority you are notified that any use or dissemination of this information in any manner is strictly such cases please notify us immediately at and delete this mail from your records.

Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex pregnancy sexual orientation gender identity national origin age protected veteran status or disability status.