C
Full Time Any

Job detail

Sr. Azure Data Engineer

Compunnel Inc

Myrtle Point, Oregon, United States

Job description

Job Title: Sr. Azure Data Engineer
Location: Remote
Senior Data Engineer to support a leading energy organization headquartered in Baltimore, MD. This role is responsible for designing, building, and optimizing enterprise-scale data platforms and cloud-based data solutions within the Microsoft Azure ecosystem. The ideal candidate will have deep expertise in Azure, Databricks, PySpark, SQL, and modern data warehousing practices, with a proven ability to deliver scalable, reliable, and high-performance data solutions that drive business value.
Required Qualifications
Core Technical Experience
5+ years of experience with Microsoft Azure cloud services
3+ years of hands-on experience with Azure Databricks
5+ years of experience developing solutions using PySpark
8+ years of experience in data warehousing and data engineering
8+ years of advanced SQL development and database design experience
Education & Experience
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field
8+ years of professional experience in data engineering, software development, or related technical disciplines
Equivalent combination of education and relevant experience will be considered

Key Responsibilities
Data Engineering & Architecture
Design, develop, implement, and support scalable cloud-based data platforms and data pipelines using Azure services and Databricks.
Build and maintain efficient ETL/ELT processes for structured and unstructured data sources.
Design and optimize enterprise data warehouses, data lakes, and modern analytics platforms.
Develop high-quality, secure, maintainable, and scalable data solutions following engineering best practices.
Create and optimize complex SQL queries, database objects, stored procedures, views, and batch processing solutions.
Design and implement data models that support reporting, analytics, and operational business needs.
Cloud & Platform Engineering
Evaluate, recommend, and implement Azure-native technologies to improve platform performance, scalability, and reliability.
Support cloud migration initiatives and modernize legacy data environments.
Design and maintain CI/CD pipelines using Azure DevOps and Git-based source control practices.
Ensure data engineering solutions align with enterprise architecture standards, security requirements, and governance policies.
Collaboration & Leadership
Partner with business stakeholders, analysts, architects, and development teams to translate business requirements into technical solutions.
Lead technical design discussions and contribute to architectural decisions across data platforms.
Conduct code reviews and promote engineering best practices, quality standards, and continuous improvement initiatives.
Mentor junior engineers and provide technical guidance across the team.
Communicate complex technical concepts effectively to both technical and non-technical audiences.
Operations & Continuous Improvement
Troubleshoot and resolve issues across data pipelines, databases, integrations, and cloud services.
Monitor and optimize data platform performance, reliability, and cost efficiency.
Stay current with emerging technologies, industry trends, and Azure best practices.
Contribute to technical documentation, standards development, and knowledge-sharing initiatives.

Preferred Technical Skills
Azure Databricks
Azure Data Factory (ADF)
Azure SQL Database / Azure Synapse Analytics (SQL DW)
PySpark and Spark SQL
Python
Advanced T-SQL
Azure DevOps
Git/GitHub
Data Lake and Data Warehouse architectures
Data modeling and database design
REST APIs and data integrations
Azure Functions
Event-driven architectures
CI/CD implementation
Agile/Scrum methodologies
Data Technologies
Experience working with:
Delta Lake
Parquet
JSON
Avro
Structured and unstructured datasets

Need help finding a job?

Chat with our AI assistant.