Lead I - Software Engineering
Posted on :
14-03-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Req ID : 2627186
Overview:
TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client provider of digital technology and transformation information technology and services
Position: Lead I Software Engineering
Location: Austin TX 78746
Duration: 7 Months
Job Type: Contract
Work Type: Onsite
Job Description:
Overview
Responsibiities :
- Apache Spark: Strong understanding and handson experience with Apache Spark including Spark SQL Spark Streaming.
- Databricks: Proficiency in using Azure Databricks including setting up and managing clusters notebooks and jobs.
- Python and SQL: Strong programming skills in either Python and SQL as these are the primary languages used for writing Spark applications.
- Data Processing and Analysis: Experience in designing and implementing data processing and analysis pipelines using Spark and Databricks.
- Distributed Computing: Knowledge of distributed computing concepts and experience with distributed computing frameworks like Spark.
- Cloud Platform: Familiarity with Azure cloud platform and its services including Azure Data Factory Azure access Azure Storage Azure Data Lake and Azure SQL Database.
- Data Engineering: Understanding of data engineering concepts and experience with ETL processes data modeling and data warehousing.
- Performance Optimization: Ability to optimize Spark applications for performance and scalability including tuning Spark configurations and leveraging Spark optimizations.
- Data Security and Governance: Understanding of data security and governance practices including data encryption access controls and compliance regulations.
- Monitoring and Troubleshooting: Proficiency in monitoring and troubleshooting Spark applications identifying and resolving performance bottlenecks or issues.
- Collaboration and Communication: Excellent communication skills and the ability to collaborate effectively with crossfunctional teams including data scientists data engineers and business stakeholders.
Desired skills:
- Must know Spark Databricks Azure and Linux OS experience.
- Experience in Spark platform performance improvements and Capacity planning. Knowledge of cloud platformbased database troubleshooting.
- Experience with CI/CD pipelines version control systems (e.g. Git) and automated deployment of Spark applications.
TekWissen Group is an equal opportunity employer supporting workforce diversity.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
