About the job: Data Engineer
Career Level : Mid-level
Location : Hybrid / Onsite
Who We Are:
This is Spearhead Technology where every challenge is an opportunity and every solution is a masterpiece in the making. As a full-lifecycle IT company we transcend mere delivery; we engineer success.
From inception to implementation our seasoned expertise shepherds every phase of the journey. Be it planning analysis design development testing or the seamless transition to production we stand as steadfast partners in our clients progress.
At Spearhead Technology quality isnt a mere aspiration its our ethos. Rooted in Tech Advisory our methodology is guided by insights that spark transformative outcomes. We recognize the paramount importance of talent retention. Through a steadfast commitment to work-life balance competitive remuneration packages and an optimized operational model we ensure our team remains as exceptional as our services.
Step into Spearhead Technology where innovation meets precision and together lets sculpt the future of technology with finesse and distinction.
Requirements
We are seeking individuals who demonstrate exceptional skills and are passionate about making a difference.
Responsibilities:
- Work with a team of data and software engineers to deliver big data streaming platform and data management capabilities.
- Develop cutting edge software solutions by writing maintainable extensible tested code while complying with coding standards
- Be hands-on and lead from the front in following best practices in development microservices design and CI/CD methodologies
- Facilitate end to end user testing with customers.
- Troubleshoot debug and upgrade existing systems.
- Help bridge gaps between Toyota Connected other Toyota Entities and 3rd party suppliers.
- Work closely with product owners to shape and deliver features to customers.
- Embrace emerging technology opportunities and contribute to our best practices driving overall architecture security design.
- Write full-stack software and tooling ensuring code is well-tested and performant.
- Develop tools and libraries that will enable rapid and scalable development in the future.
- Contribute to all aspects of the software development life cycle across multiple interconnected software products.
- Support responsibilities will include investigating issues our customers have with retrieving data via our data products.
- debugging APIs cloud services and data lake technologies
Required Qualifications:
- 3 years of data engineering experience
- Solid experience writing clean concise tested maintainable code in python.
- Experience building and deploying applications in AWS
- API development experience
- Experience utilizing Spark and SQL
- Experience with Databricks or EMR
- Experience with CI/CD and updating build pipelines and pipeline tasks
- Hands-on production experience working with Big Data platforms building and optimizing data pipelines that involve data processing and streaming platforms
- Experience in test automation frameworks optimizing performance and security enabling delivery of robust and maintainable architecture.
- Ability to learn and apply new technologies programming practices patterns and methods
- Demonstrates advanced problem-solving troubleshooting decision making skills
- Organized and detail-oriented
- Ability to develop healthy working relationships and collaborate with peers and leaders
- Exhibits integrity and high standards in work quality
- Excellent verbal and written communication skills
- Values diversity and differences amongst individuals in interactions
Benefits
What s in it for you:
At Spearhead Technology we prioritize your well-being and professional growth. Heres what you can expect:
- Achieve a healthy work-life balance.
- Competitive compensation and abundant growth opportunities.
- Enjoy a standard 5-day workweek with 2 fixed weekly offs.
- Experience an employee-centric environment with supportive policies.
- Benefit from family-friendly and flexible work arrangements.
- Access our Performance Advancement and Career Enhancement (PACE) initiative and discover opportunities for both personal and professional growth. From tailored career development plans to expert counseling services PACE empowers you to chart your course to success with confidence and clarity.
Elevate your career trajectory with our Learning & Development (L&D) program. Join our team and embark on a transformative journey of upskilling and self-discovery. With continuous learning as your compass youll not only enhance your expertise but also open doors to new opportunities paving the way for career growth and fulfillment.
Please note : At Spearhead Technology we value the importance of collaboration learning and fostering connections with clients peers leaders and communities. While some in-person engagement may be required for certain roles we are committed to providing flexibility to accommodate your individual work-life balance needs.
As an equal opportunities employer Spearhead Technology welcomes and encourages applications from all members of society. We are dedicated to creating an inclusive environment where diversity is celebrated and individuals are valued for their unique perspectives and contributions. We do not discriminate on the basis of race religion or belief ethnicity disability age citizenship marital or civil partnership status sexual orientation or gender identity.
Responsibilities: Work with a team of data and software engineers to deliver big data streaming platform and data management capabilities. Develop cutting edge software solutions by writing maintainable, extensible, tested code, while complying with coding standards Be hands-on and lead from the front in following best practices in development, microservices design and CI/CD methodologies Facilitate end to end user testing with customers. Troubleshoot, debug and upgrade existing systems. Help bridge gaps between Toyota Connected, other Toyota Entities, and 3rd party suppliers. Work closely with product owners to shape and deliver features to customers. Embrace emerging technology opportunities and contribute to our best practices, driving overall architecture, security, design. Write full-stack software and tooling, ensuring code is well-tested and performant. Develop tools and libraries that will enable rapid and scalable development in the future. Contribute to all aspects of the software development life cycle across multiple, interconnected software products. Support responsibilities will include investigating issues our customers have with retrieving data via our data products. debugging APIs, cloud services, and data lake technologies Required Qualifications: 3+ years of data engineering experience Solid experience writing clean, concise, tested, maintainable code in python. Experience building and deploying applications in AWS API development experience Experience utilizing Spark and SQL Experience with Databricks or EMR Experience with CI/CD and updating build pipelines and pipeline tasks Hands-on production experience working with Big Data platforms, building and optimizing data pipelines that involve data processing and streaming platforms Experience in test automation frameworks, optimizing performance and security enabling delivery of robust and maintainable architecture. Ability to learn and apply new technologies, programming practices, patterns, and methods Demonstrates advanced problem-solving, troubleshooting, decision making skills Organized and detail-oriented Ability to develop healthy working relationships and collaborate with peers and leaders Exhibits integrity and high standards in work quality Excellent verbal and written communication skills Values diversity and differences amongst individuals in interactions
Education
Bachelor's Degree