|
Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Senior Data Engineer Location(s): Dunwoody, GA
Job Summary:
We are seeking a highly skilled Data Engineer to join our data engineering team. The ideal candidate will have extensive experience in building robust ETL pipelines, implementing efficient data ingestion strategies, and working with tools like Python, Spark, and Databricks. This role will involve collaborating with cross-functional teams to ensure data integrity, scalability, and optimal performance for our data-driven solutions.
Key Responsibilities:
- Design, develop, and maintain scalable ETL pipelines to ingest and transform data from multiple sources.
- Implement data integration strategies using Python, Spark, and Databricks to enable seamless data ingestion and transformation.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
- Develop and optimize data workflows to improve data quality, consistency, and performance.
- Ensure data security, governance, and compliance best practices are followed.
- Conduct performance tuning of Spark jobs and optimize data queries to minimize latency and improve efficiency.
- Automate data pipelines using CI/CD tools and ensure continuous data delivery.
- Troubleshoot data issues, identify root causes, and implement effective solutions.
Required Qualifications:
- Strong proficiency in Python, with experience in data manipulation libraries like Pandas and PySpark.
- Extensive experience with Apache Spark for data processing and analysis.
- Hands-on experience with Databricks for building scalable data pipelines.
- Experience with data lakes, data warehouses, and cloud platforms like AWS, Azure, or GCP.
- Strong SQL skills for data extraction, transformation, and querying.
- Familiarity with version control systems (e.g., Git) and CI/CD processes.
- Excellent problem-solving skills, attention to detail, and ability to work collaboratively.
Preferred Skills:
- Experience with workflow orchestration tools like Apache Airflow, Dagster, or Prefect.
- Knowledge of data modeling techniques and best practices.
- Familiarity with data visualization tools such as Power BI, Tableau.
- Understanding of data privacy regulations and security protocols.
Ampcus is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veterans or individuals with disabilities.
|
Ampcus, Inc
Apr 03, 2025