Company Overview
For over 25 years Prudent Technologies & Consulting has been helping customers secure the technical and functional resources needed to deliver missioncritical IT & Business initiatives. Prudents specialty practices include Data Sciences Cybersecurity App Dev and Enterprise CRM with partnerships with top technology firms like Salesforce Splunk Microsoft and Databricks.
Job Overview
MidLevel Data Engineer role with 4 to 6 years of experience in Hyderabad Telangana India. FullTime employment type.
Qualifications and Skills
- Bachelors or masters degree in Computer Science Engineering Information Technology or a related field.
- 3 years of proven experience in data engineering with a strong emphasis on ETL pipeline design and API development.
- Expertise in Python with extensive experience using data processing libraries (e.g. Pandas NumPy) and ETL tools.
- Proficient in developing RESTful APIs with Flask or Django and familiar with API authentication and authorization mechanisms.
- Solid understanding of SQL and experience with relational databases (e.g. PostgreSQL MySQL) and NoSQL databases (e.g. MongoDB Cassandra).
- Experience with cloud services (e.g. AWS Google Cloud Azure) and their data services is highly desirable.
- Strong knowledge of data warehousing concepts data modeling and schema design.
- Excellent problemsolving skills and the ability to manage complex projects with tight deadlines.
- Strong communication skills capable of working collaboratively with both technical and nontechnical team members.
- Roles and Responsibilities
- Design build and maintain efficient reliable and scalable ETL pipelines to extract transform and load data from various sources into data stores using Python.
- Develop RESTful APIs using Flask or Django to enable seamless data access and manipulation by internal and external systems.
- Ensure optimal data processing architecture by implementing effective database solutions and data storage practices.
- Collaborate with the engineering team to integrate ETL processes and APIs into application ecosystems.
- Monitor troubleshoot and optimize data systems to ensure their reliability and performance.
- Manage data security backup and recovery specifications to ensure data integrity and availability.
- Document ETL processes API endpoints and data models maintaining clear and concise documentation for all developed systems.
- Keep abreast of new technologies and advocate for their adoption where they can enhance the functionality and efficiency of data systems.
Required Experience:
Manager