PySpark Developer
Minneapolis, MN - USA
Job Summary
Wipro Technologies-USA invites applications for the position of Solution Architect L1 specializing as a PySpark Developer within our esteemed Technology Services sector. This pivotal role is part of the TS - DATA ANALYTICS & AI group focusing on Data Transformation initiatives that drive our clients digital evolution.
As a PySpark Developer you will leverage your extensive expertise in Spark Open Source technology to design architect and implement scalable big data solutions that meet complex business objectives. You will collaborate closely with cross-functional teams including data engineers analysts and business stakeholders to translate data requirements into robust architectures ensuring high performance and reliability.
Key competencies essential for success include being respectful in all interactions maintaining clear and consistent communication demonstrating stewardship over data assets and solutions responding promptly to evolving project needs and building trust within the team and with client partners. Your role will involve leading technical discussions crafting best practice guidelines and ensuring compliance with industry standards.
Candidates considered for this role should possess between 8 to 10 years of professional experience in data analytics specifically working with Spark Open Source technologies. A strong understanding of distributed computing data processing frameworks and cloud platforms will be advantageous. The position demands a strategic thinker with a hands-on approach able to balance architectural oversight with practical coding when required.
Compensation for this role is competitive and ranges from $80000 to $158000 annually. Final salary will reflect several factors including your geographic location applicable minimum wage regulations specific skills and relevant professional addition this position is eligible for Wipros comprehensive benefits package encompassing medical and dental insurance options disability coverage paid time off including sick leave and other statutory leave provisions.
Wipro is committed to fostering an inclusive workplace where all employees and applicants receive equal opportunity. We prohibit discrimination and harassment based on race color religion age sex national origin disability genetics veteran status sexual orientation gender identity or expression or any other characteristic protected by law. We actively encourage applications from veterans and persons with disabilities.
Your journey at Wipro will be one of continuous reinventionof your knowledge career and skills. You will join a future-focused organization dedicated to pioneering digital transformation with bold this dynamic environment you are empowered to innovate and design your own path forward. Become part of a company that embraces change champions purpose and supports your professional evolution every step of the way.
Role: PySpark Developer
Location: Irving TX (3 Days onsite/week)
Job Description:
We are looking for an experienced PySpark Developer with over 7 years of hands-on experience in designing developing and optimizing large-scale data processing applications. The ideal candidate should have strong expertise in PySpark Azure cloud services Docker and Azure Kubernetes Service (AKS) with the ability to build scalable secure and high-performing data solutions.
Key Responsibilities
Design develop and maintain scalable data pipelines using PySpark for large-volume data processing.
Work with Azure cloud services to build reliable and efficient data engineering solutions.
Deploy manage and monitor containerized applications using Docker and Azure Kubernetes Service (AKS).
Collaborate with data architects analysts and business stakeholders to understand requirements and deliver high-quality data solutions.
Optimize PySpark jobs for performance scalability reliability and cost efficiency.
Implement best practices for data ingestion transformation validation and processing across cloud environments.
Identify and fix application container and platform vulnerabilities to ensure secure deployments.
Support troubleshooting production issue resolution and performance tuning of data pipelines and cloud-based applications.
Participate in code reviews technical discussions deployment planning and documentation activities.
Required Skills
Strong hands-on experience in PySpark development for distributed data processing.
Experience with Azure Kubernetes Service (AKS) for deploying and managing containerized workloads.
Proficiency in Docker for containerization image management and deployment workflows.
Solid working knowledge of Azure cloud services and cloud-native application development.
Strong understanding of data engineering concepts ETL/ELT processes and performance optimization.
Ability to troubleshoot complex technical issues and deliver timely resolutions.
Good-to-Have Skills
Working knowledge of Python for scripting automation and data processing support.
Experience with SSIS for ETL workflow development and migration activities.
Exposure to Informatica for data integration and enterprise data management.
Experience in identifying analyzing and fixing security vulnerabilities across applications containers and cloud deployments.
Experience and Qualifications
7 years of overall experience in data engineering big data development or related technology roles.
Strong practical experience in building and supporting production-grade PySpark-based data pipelines.
Experience working in cloud-based environments preferably Microsoft Azure.
Good understanding of CI/CD practices DevOps workflows and container-based deployments.
Strong analytical problem-solving and communication skills.
Ability to work independently as well as collaboratively in a fast-paced delivery environment.
Preferred Candidate Profile
The ideal candidate will be a technically strong PySpark Developer who can take ownership of data engineering solutions work effectively with Azure-based platforms manage containerized deployments using Docker and AKS and ensure secure optimized and reliable delivery of data processing applications.
Required Experience:
IC
About Company
As a global leader, Wipro blends consulting and AI expertise across design, engineering and operations to accelerate business transformation and deliver future-ready technology.