Senior Data Engineer

This is a remote position.

What you will do

• Analyze system requirements and design responsive algorithms and solutions
  

• Use big data and cloud technologies to produce production quality code
  

• Engage in performance tuning and scalability engineering
  

• Work with team, peers and management to identify objectives and set priorities
  

• Perform related SDLC engineering activities like sprint planning and estimation
  

• Work effectively in small agile teams
  

• Provide creative solutions to problems
  

• Identify opportunities for improvement and execute
  

Must haves

• Bachelor s degree in computer science, information systems, math, engineering, or other technical field, or equivalent experience
  

• Six years of experience with Python or Java
  

• Four or more years of experience in building data lake, cloud data platform leveraging cloud (GCP/AWS) cloud native architecture, ETL/ELT, and data integration
  

• Three years of development experience with cloud services ( AWS,GCP,AZURE) utilizing various support tools (e.g. GCS, Dataproc, Cloud Data flow, Airflow(Composer), Kafka , Cloud Pub/Sub)
  

• Expertise in developing distributed data processing and Streaming frameworks and architectures (Apache Spark, Apache Beam, Apache Flink, )
  

• In-depth knowledge of NoSQL database technologies (e.g. MongoDB, BigTable, DynamoDB)
  

• Expertise in build and deployment tools (Visual Studio, PyCharm, Git/Bitbucket/Bamboo, Maven, Jenkins, Nexus, )
  

• Five years of experience and expertise in database design techniques and philosophies (e.g. RDBMS, Document, Star Schema, Kimball Model)
  

• Five years of experience with integration and service frameworks (e.g API Gateways, Apache Camel, Swagger API, Zookeeper, Kafka, messaging tools, microservices)
  

• Expertise with containerized Microservices and REST/GraphQL based API development
  

• Experience leveraging continuous integration/development tools (e.g. Jenkins, Docker, Containers, OpenShift, Kubernetes, and container automation) in a Ci/CD pipeline
  

• Advanced understanding of software development and research tools
  

• Attention to detail and results oriented, with a strong customer focus
  

• Ability to work as part of a team and independently
  

• Analytical and problem-solving skills
  

• Problem-solving and technical communication skills
  

• Ability to prioritize workload to meet tight deadlines
  

The benefits of joining us

• Professional growth - accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
  

• Competitive compensation - we match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
  

• A selection of exciting projects - join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
  

• Flextime - tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office whatever makes you the happiest and most productive.
  

Check out more about AgileEngine culture and opportunities at