Data Engineer 2
Data Engineer 2
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Every career journey is personal. Thats why we empower you with the tools and support to create your own success story.
Be challenged. Be heard. Be valued. Be you ... be here.
Job Summary
The Data Engineer II works on different projects of data engineering to support the use cases data ingestion pipeline and identify potential process or data quality issues. The team also supports marketing analytic teams with analytical tools that enable our analytics and business communities to do their job easier faster and smarter. The team brings together data from different internal & external partners and builds a curated Marketing analytics focused data & tools ecosystem. The Data Engineer plays a crucial role in building this ecosystem depending on the Marketing analytics communities need.Essential Job Functions
Collaboration Collaborates with internal/external stakeholders to manage data logistics including data specifications transfers structures and rules. Collaborates with business users business analysts and technical architects in transforming business requirements into analytical workbenches tools and dashboards reflecting usability best practices and current design analytical interpersonal and professional communication skills. Learns quickly and works effectively individually and as part of a team.
Process Improvement Accesses extracts and transformsCredit and Retail data from a variety of sources of all sizes (including client marketing databases 2ndand 3rdparty data) using Hadoop Spark SQL Big data technologies automation help to analytical teams around data centric needs using orchestration tools SQL and possibly other big data/cloud solutions for efficiency improvement.
Project Support SupportsSr. Specialist and Specialist in new analytical proof of concepts and tool exploration projects. Effectively managestime and computing resources in order to deliver on time/correctly on concurrent projects. Involved in creating POCs to ingest and process streaming data using Spark and HDFS.
Data and Analytics Answersand trouble shootsquestions about data sets and analytical tools; Develops maintainsand enhancesnew and existing analytics tools/Frameworks to support internal customers/consumers. Ingestsdata from different sources processesit according to the requirement document in order to store data to Hive or NoSQL database or different warehousing solutions. Managesdata coming from different sources involved in HDFS maintenance and loading of structured and unstructured data. Appliesknowledge in Agile Scrum methodology that leverages the ClientBigDataplatform and used version control tool Git. Importsand exportsdata using Sqoop from HDFS to RDBMS and viceversa. Demonstratesan understanding of Hadoop Architecture and underlying Hadoop framework including Storage Management. CreatesPOCs to ingest and process streaming data using Spark and HDFS. Work on backend using Scala Python and Spark to perform several aggregation logics.
Technical Skills Expert in writing complicated SQL Queries and database analysis for good workingwith python or Scala Spark Hadoop Hive Oozie Sqoop HDFS Impala Shell Scripts Microsoft Azure Services like ADLS/Blob Storage solutions AzureDataFactory Azure Functions and Databricks. Utilize basic knowledge of Rest API for designing networked applications
Reports to:Lead or above
Working Conditions/ Physical Requirements: Normal office environment
Direct Reports: 0
MinimumRequirements:
Degree Required: Bachelors Degree
Area of Study: Computer Science Engineering
Years of Work Experience Required: Two to five years or more
Type / focus of work experience required: Data & Analytics
Other Duties
This job description is illustrative of the types of duties typically performed by this job. It is not intended to be an exhaustive listing of each and every essential function of the job. Because job content may change from time to time the Company reserves the right to add and/or delete essential functions from this job at any time.
About Bread Financial
At Bread Financial youll have the opportunity to grow your career give back to your community and be part of our awardwinning culture. Weve been consistently recognized as a best place to work nationally and in many markets and were proud to promote an environment where you feel appreciated accepted valued and fulfilledboth personally and professionally. Bread Financial supports the overall wellness of our associates with a diverse suite of benefits and offers boundless opportunities for career development and nontraditional career progression.
To learn more about Bread Financial our global associates and our sustainability commitments visit or follow us on Instagram and LinkedIn.
All job offers are contingent upon successful completion of credit and background checks.
Bread Financial is an Equal Opportunity Employer.
Job Family:
Information TechnologyJob Type:
RegularEmployment Type
Full-Time
