drjobs Data Leaddata warehouseetlawsrdbms-10 Years-Hyderabad

Data Leaddata warehouseetlawsrdbms-10 Years-Hyderabad

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Hyderabad - India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Strong AWS knowledge in terms of designing new architecture and providing optimized solution for existing one.
Indepth knowledge with respect to Snowflake and its architecture.
provide solutioning and drive the implementation of DOPS features which includes building IAC infra Git Lab restructuring Git lab Upgrades monitoring etc.
Should have the vision on data strategy and able to deliver the same.
Should be able to lead the design and implementation of data management processes including data sourcing integration and transformation.
Able to manage and lead a team of data professionals providing guidance mentoring and foster a collaborative and innovative team culture focused on continuous improvement.
To evaluate and recommend datarelated technologies tools and platforms.
Collaborate with IT teams to ensure seamless integration of data solutions.
should have experience in Implementing
Work with stakeholders to understand needs for data structure availability scalability and accessibility.
Develop tools to improve data flows between internal/external systems and the data lake/warehouse.
Build robust and reproducible data ingest pipelines to collect clean harmonize merge and consolidate data sources.
Understanding existing data applications and infrastructure architecture
Build and support new data feeds for various Data Management layers and Data Lakes
Evaluate business needs and requirements
Support migration of existing data transformation jobs in Oracle and MSSQL to Snowflake.
Lead the migration of the existing data transformation jobs in Oracle Hive Impala etc. into Spark Python on Glue etc.
Able to document the processes and steps.
Develop and maintain datasets.
Improve data quality and efficiency.
Lead Business requirements and deliver accordingly.
Collaborate with Data Scientists Architect and Team on several Data Analytics projects.
Collaborate with DevOps Engineer to improve system deployment and monitoring process.

Overall 10 years work experience
At least 6 years of strong data warehousing experience using RDBMS and NonRDBMS databases.
Experience as a Lead 5 years.
Bachelor qualification in a computer science or STEM (science technology engineering or mathematics) related field.
At least 5 years of recent handson professional experience (actively coding) working as a data engineer (backend software engineer considered).
At least 4 years of experience in ETL (AWS Glue) Amazon S3 Amazon RDS Amazon Lambda Apache Airflows Amazon Step Functions.
Professional experience working in an agile dynamic and customer facing environment is required.
Understanding of distributed systems and cloud technologies (AWS) is highly preferred.
Understanding of data streaming and scalable data processing is preferred to have.
Experience with large scale datasets data lake and data warehouse technologies such as AWS Redshift Google BigQuery Snowflake. Snowflake is highly preferred.
Strong knowledge in scripting languages like Python UNIX shell and Spark is required.
Understanding of RDBMS Data ingestions Data flows Data Integrations etc.
Technical expertise with data models data mining and segmentation techniques.
Experience with full SDLC lifecycle and Lean or Agile development methodologies.
Knowledge of CI/CD and GIT Deployments.
Ability to work in team in diverse/ multiple stakeholder environment.
Ability to communicate complex technology solutions to diverse teams namely technical business and management teams.

Ability to work in a collaborative environment and coach other team members on coding practices design principles and implementation patterns that lead to highquality maintainable solutions.
Ability to work in a dynamic agile environment within a geographically distributed team.
Ability to focus on promptly addressing customer needs.
Ability to work within a diverse and inclusive team.
Technically curious selfmotivated versatile and solution oriented.

agile,etl,data quality,data warehousing,data management,data,data integration,snowflake,aws,data lake,etl tools,data transformation,data warehouse,ci/cd,git,spark,rdbms,python,data engineering,apache airflow

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.