Big Data Engineer
Share
Job Location:
Any - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Department:
Product Development
Job Summary
Responsibilities
- Use your software engineering skills including Java Spark Python Scala to Analyze different complex systems and collaboratively design new products and services
- Integrate new data sources and tools
- Implement scalable and reliable distributed data replication strategies
- Mentor and provide direction in architecture and design to onsite/offshore developers
- Collaborate with other teams to design and deploy data tools that support both operations and product use cases
- Perform analysis of large data sets using components from the Hadoop ecosystem
- Manage product features from the development testing through to production deployment
- Evaluate big data technologies and prototype solutions to improve our data processing architecture
- As a Big Data Engineer you will be reporting to the Director Software Development
Qualifications :
- BS degree in computer science computer engineering or equivalent
- 56 years of experience delivering enterprise software solutions
- Proficient in Spark Scala Python AWS Cloud technologies
- 3 years of experience across multiple Hadoop / Spark technologies such as Hadoop MapReduce HDFS HBase Hive Flume Sqoop Kafka Scala
- Flair for data schema data model how to bring efficiency in big data related life cycle
- Technical requirements and can translate them into technical implementations
- Experience with Agile Development methodologies
- Experience with data ingestion and transformation
- Solid understanding of secure application development methodologies
- Experience with Airflow and Python
- Understanding of automated QA needs related to Big data
- Object-oriented design and experience approaching a problem from different angles analyzing the pros and cons of different solutions skills
- Experience communicating updates and resolutions to customers and other partners
Additional Information :
Benefits.
- 20 vacation days to start (along with 12 paid holidays)
- Great compensation package and comprehensive benefits package with a bonus of 20%
- Flexible work schedule and relaxed dress code
Our uniqueness is that we celebrate yours. Experians culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI work/life balance development authenticity collaboration wellness reward & recognition volunteering... the list goes on. Experians people first approach is award-winning; Worlds Best Workplaces 2024 (Fortune Top 25) Great Place To Work in 24 countries and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.
Our compensation reflects the cost of labor across several U.S. geographic markets. The base pay range for this position is listed above. Within this range individual pay is determined by work location and additional factors such as job-related skills experience and education. This position is also eligible for a variable pay opportunity and a comprehensive benefits package.
Experian is proud to be an Equal Opportunity Employer for all groups protected under applicable federal state and local law including protected veterans and individuals with disabilities. Innovation is an important part of Experians DNA and practices and our inclusive workforce allows everyone to succeed and bring their whole self to work. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.
#LI-Remote
Remote Work :
Yes
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, ... View more
