Data Engineer Specialist in Big Data
Data Engineer Specialist in Big Data
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Team and Culture Description
Telefonica has global reach and presence with 317 million customers owning network in 15 countries operations in 44 countries and 650 roaming agreements worldwide giving us real data on an incredibly large sample of our society.
The use of Data Science and Advanced Analytics with value creation from Big Data is one of Telefonicas main priorities enhancing our ability to anticipate customer needs and offer them relevant and personalized services not only faster but at the right time and also capturing external business opportunities in the sector.
Vivo Data Labs is a group dedicated to design and create solutions that leverage on Telefnicas big data assets in Brazil to provide useful insights enlightening the space between the organization and our users in order to improve propositions and business effectiveness. The team develops a range of algorithms and machine learning techniques combining different datasets such as call center logs and records traffic detail records (voice data SMS and video) navigation records through companys digital channels and much more as including traditional sources of telecom data.
The team works closely with various stakeholders inside Telefonica Vivo and collaborates with other Data Labs groups from Global Telefonica and other Telefonica business operations.
Job Description
The candidate will be responsible for:
- All the process of data governance and data management including all the ETL process of different data sources (collecting ingesting validating homogenization transformation and modeling
- Collaborate with IT in the data ingestion process into Hadoop plataform and in database SQL (structured) and noSQL (unstructured)
- Data transformation with Hadoop and Hive using Java or Python to generate metrics and relevant variables (KPIs)
- Create and automatize data homogenization processes
- Manage all the data pipeline ensuring data quality by creating control mechanisms
- Provide datasets ready to be used by Data Scientists and BI Analysts
- Develop softwares in Big Data Hadoop ecosystem Hadoop and Spark for analytics statistics and machine learning.
- Resolve scalability and productivity problems
- Self-service data: create necessary mechanisms to facilitate and allow no-tech users to access the processed data
- Develop proof of concepts in order to make datasets useful for building analytical models and reports
- Collaborate with the discussions regarding Big Data platform roadmap and strategy as well as the capabilities of the analytical environment and its data sources
- Manage relationship with vendors of Big Data and Analytics solutions available in the market between well-known ones and the new ones that has been emerging in order to maximize profitability
- Collaborate with the integration of new Big Data/Analytical platforms and the traditional systems of reporting data warehouse campaign platforms and business KPIs
- Defining the information pipeline between data sources traditional storaging and new Big Data platforms minimizing operational impact
- Provide technical leadership within Telefonicas operations as an authority and reference on application development for data quality in BI & Big Data environment.
The position is based in Sao Paulo-SP.
Basic Qualifications & Experience
- BA/BS degree or equivalent practical experience in a highly technical field such as Computer Science Engineering (Electronic Mechatronic Computer) or other relevant applied field
- 2 years of experience working with ETL tools (Talend DataStage Informatica ODI) data manage and data integration
- 2 years of experience creating managing and optimizing data models and databases NoSQL or RDBMS SQL DB and relational databases
- 2 years of experience in programming languages: Java C PHP Ruby Python and/or R Linux scripting
- Knowledge in Linux/Unix operation system
- 2 years of practical experience interacting and programming on Big Data Platform (Hadoop Hive Hue MapReduce Spark Netezza)
- Deep knowledge in different Big Data technologies such as: Hadoop Spark Cloud Technologies MongoDB Elastic Search
- 1 year of experience working with design and integration of end-to end systems and solutions for analytical environment and Business Intelligence using Big Data
- 1 year of experience and familiarity with Data Discovery and Data Visualization tools: Business Objects Microstategy Tableau QlickView Datameer
- Wide understanding of different data storage traditional architectures (Teradata and Oracle) and Data Warehouse concepts
- Knowledge of todays commercial and Open Source panorama of tools related to Big Data and Analytics
- Strong capacity of planning leading and communicating empathically with technical and business peers adapting necessities of the areas that explore information
- Ability to solve complex problems using creativity
- Good disposition to work as a team and collaborative mentality
- Excellent verbal and writing English skills and fluent Portuguese
- Experience in software developing regarding designing coding and testing as well as experience in software platforms engineer and large-scale data infrastructure (commercial or open source)
Preferred Qualifications & Experience
- MS and/or PhD in Engineering Computer Science or other relevant quantitative & applied field.
- Data Science experience
- High level of Spanish proficiency
- Experience in the telecommunications industry or basic understanding of the mobile industry
Contact info:
Required Experience:
Unclear Seniority
Employment Type
Full-Time
