Leading national automotive sub-prime consumer finance company has a Senior Data Engineer career opportunity open at the national headquarters in Carmel, Indiana. This is a hybrid position that requires 3 days in the office each week. We offer a competitive starting pay based on experience, great benefits and a newly remodeled corporate office.
Job Summary for Senior Data Engineer:
We seek a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure, ensuring the availability, reliability, and performance of our data systems. You will drive the data engineering initiatives and collaborate closely with cross-functional teams to support data-driven decision-making within the organization. You must also be skilled at finding solutions to problems while keeping the environment well-structured, stable, and secure. This position reports to the Director of Solutions Engineering.
Specific Responsibilities for Senior Data Engineer:
● Data Architecture: Lead the design and development of complex data pipelines, data models, and data integration solutions that meet business requirements and performance standards
● Data Ingestion: Architect and oversee the development of efficient and scalable data ingestion processes from various sources, including databases, APIs, and external data providers (AWS Redshift, AWS DynamoDB, AWS S3, MS SQL, etc.)
● Data Transformation: Develop advanced data transformation pipelines and ETL processes to convert raw data into structured and meaningful formats
● Data Quality: Establish and enforce best practices for data quality, validation, cleaning, and error handling
● Data Storage: Manage and optimize data storage solutions, including databases, data lakes, and cloud storage services
● Data Security: Implement advanced data security measures and access controls to protect sensitive data
● Performance Optimization: Continuously monitor and optimize the performance of data pipelines and databases, implementing best practices to ensure efficient data processing
● Collaboration: Collaborate closely with leadership, analysts, and business stakeholders to understand their data requirements and deliver advanced data solutions that meet their evolving needs
● Innovation: Stay at the forefront of emerging data engineering technologies, industry trends, and best practices, and drive innovation within the data engineering domain
● Documentation: Maintain comprehensive documentation of data pipelines, data models, and processes, and ensure knowledge sharing within the team
Products and Stacks for Senior Data Engineer:
Languages
● C#
● Python
● TSQL
● Java
● Scala
Frameworks
● .Net Core
● .Net Framework
● ASP .NET
Database
● MS SQL
● DynamoDB
● Redshift
● Postgresql
Amazon Web Services
● ECS
● Cloudwatch
● Lambda
● S3
● Secrets
● DynamoDB
● API Gateway
● SNS
● SQS
● SES
● CloudFormation
● Glue
Azure Cloud Services
● Service Fabric Clusters
● Service Bus
● App Services
● Application Insights
● Key Vaults
● Databricks
● Function Apps
Tools and Platforms
● Docker
● Bitbucket
● Azure Devops
● Jira
● Confluence
● Lucidspark
● Looker
Skills of Senior Data Engineer:
● Proven experience as a Senior Data Engineer, with a strong understanding of information data security and data access controls
● Proficiency in programming languages such as Python, Java, or Scala
● Strong SQL skills and deep experience with database technologies (e.g., SQL, NoSQL)
● Expertise in data warehousing and ETL tools (e.g., Kodda, AWS Glue)
● Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization (e.g., Docker, Kubernetes)
● Extensive knowledge of data modeling techniques and data warehouse design
● Excellent problem-solving and communication skills
● Ability to work collaboratively in a team, adapt to a fast-paced, evolving environment, and work individually to accomplish goals
● Experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization (e.g., Docker, Kubernetes)
● Familiarity with big data technologies and tools (e.g., Hadoop, Spark)
● Strong commitment to data accuracy, data quality, and data security
● Ability to work with minimal supervision.
Qualities of Senior Data Engineer:
● Strong teamwork is a must
● Resilience and resourcefulness
● Strong customer service focus
● High energy with self-motivation
● Ability and eagerness to solve problems
Educational Requirements of Senior Data Engineer:
● Bachelor's degree in Computer Science, Information Technology, or equivalent experience
● Technology-related certifications are a plus
Experience Required of Senior Data Engineer:
● 3+ years of Python experience
● 3+ years of SQL experience
● 3+ years of experience with data modeling and data warehousing
● Experience with frameworks and products described in “Products and Stacks” section
● Experience with standard tools such as Atlassian product suite, AWS, and/or Azure DevOps
...communication skills Ability to effectively resolve complaints Shell is the market leader through approximately 14,000 Shell-branded gas stations in the U.S. which also serve as Shell's most visible public presence, and comes closest to serving all 50 states, lacking a...
...Difference in Mental Health! Are you a compassionate and skilled psychiatrist looking for a fulfilling career opportunity? Look no further!... ...How to Apply Confidentially: If you are passionate about psychiatry and eager to contribute to a positive and supportive...
...a role that gives you the opportunity to work with one of Americas top 100 most trusted... ...increasing your income from the comfort of your home? Then why not join Lionbridge as a part-... ...recruiting for the role of Online Map Quality Analysts in China. The position will allow...
Chapman Automotive is looking for Pre-Owned Sales Representatives to join our team at Chapman 22nd St. Value Center, where we specialize... ...:* Comprehensive Health Coverage: Essential medical, dental, and vision plans with low cost premiums and minimal out-of-pocket...
~ Intermodal position ~ Two full days off ~ No touch freight ~ Drop/Hook, Live loads ~ Both day and night shifts available ~ This lane travels through the east coast ~$1800 weekly average ~6 monthsof tractor trailer experience is required