Data Engineer Python Spark AWS
Data Engineer Python Spark AWS
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Wissen Technology is now hiring Data EngineerPython Spark AWS)
We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have over 4 years of experience in data engineering with a strong proficiency in Python and Spark. A solid understanding of ML Ops ML Flow Klevel (clustering or similar algorithms) Hadoop and onpremise machine learning (ML) infrastructure is highly desirable
Experience 510 years
Location: Bangalore/ Mumbai
Notice period Immediate to currently serving notice period.
Requirements:
Bachelors or Masters degree in Computer Science Information Technology Data Science or a related field. 4 years of experience in data engineering.
Strong proficiency in Python and Spark.
Understanding of ML Ops practices including ML Flow.
Familiarity with kmeans clustering or similar machine learning algorithms.
Experience with big data technologies like Hadoop.
Knowledge of onpremise ML infrastructure.
Excellent problemsolving and analytical skills.
Strong communication and teamwork abilities.
Must have skills:
1. Data Pipeline Development: o Design develop and maintain scalable data pipelines using Python and Spark. o Implement ETL (Extract Transform Load) processes to integrate data from various sources into data warehouses and data lakes. o Good understanding of data warehousing and data management concepts including OLTP OLAP Dimensional Modelling star/snowflake schemas
2. Big Data Management: o Work with big data technologies like Hadoop to manage and process large volumes of data. o Optimize data storage and retrieval processes to enhance system performance and efficiency. o Implement and manage data partitioning indexing and other optimization techniques.
3. Machine Learning Operations (ML Ops): o Collaborate with data scientists to deploy machine learning models in production environments. o Implement ML Flow for tracking and managing the lifecycle of ML models. o Ensure models are scalable reliable and maintainable within onpremise or cloudbased infrastructure. o Utilize clustering and other machine learning algorithms to analyze and interpret complex data sets.
4. Collaboration and Communication: o Work closely with crossfunctional teams including data scientists analysts and IT professionals to deliver comprehensive data solutions. o Communicate technical concepts and project status to nontechnical stakeholders effectively. o Gather and analyze requirements from business stakeholders to ensure data solutions align with organizational goals.
About Wissen Technology:
The Wissen Group was founded in the year 2000. Wissen Technology a part of Wissen Group was established in the year 2015. Wissen Technology is a specialized technology company that delivers highend consulting for organizations in the Banking & Finance Telecom and Healthcare domains. We help clients build world class products.
We offer an array of services including Core Business Application Development Artificial Intelligence & Machine Learning Big Data & Analytics Visualization & Business Intelligence Robotic Process Automation Cloud Adoption Mobility Digital Adoption Agile & DevOps Quality Assurance & Test Automation.
Over the years Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients through thought leadership ownership and assured ontime deliveries that are always first time right.
The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them with the best possible opportunities and careers which extends to providing the best possible experience and value to our clients.
We have been certified as a Great Place to Work company for two consecutive yearsand voted as the Top 20 AI/ML vendor by CIO Insider. Great Place to Work Certification is recognized world over by employees and employers alike and is considered the Gold Standard. Wissen Technology has created a Great Place to Work by excelling in all dimensions HighTrust HighPerformance Culture Credibility Respect Fairness Pride and Camaraderie.
Website: www.wissen
LinkedIn:
Employment Type
Full-Time
