Skills required
Databricks
spark
pyspark
SQL
delta_lake
lakehouse_and_awsazuregcp_data_services
Education/Qualification
Bachelor’s degree in a related field
Desirable skills
Ability to influence and build trust with C-suite stakeholders.
Years of experience
10–15 years
Position: Databricks Architect
Duties & Responsibilities:
• 10–15 years in Data Engineering, Data Platforms, or Cloud Data Architecture.
• 5+ years designing large-scale data solutions and architecting modern data platforms.
• 6 to 8 years in Databricks.
• Hands-on expertise with Databricks, Spark, PySpark, SQL, Delta Lake, and Lakehouse principles.
• Strong experience with AWS/Azure/GCP data services (Storage, IAM, Networking, Key Vault).
• Proven experience implementing CI/CD, GitOps, Terraform, and Databricks Repos/Workflows.
• Strong understanding of data governance, cataloging, lineage, and security (Unity Catalog preferred).
• Ability to translate business needs into scalable architectural solutions
• Architect and implement enterprise-scale data platforms using Databricks Lakehouse, Delta Lake, and Medallion architecture.
• Lead end-to-end design of data ingestion, transformation, orchestration, and storage solutions.
• Define architecture standards, best practices, governance models, and performance optimization strategies.
• Oversee Databricks clusters, Spark workloads, and pipeline optimizations for efficiency and cost control.
• Enable CI/CD, DevOps, and Infrastructure-as-Code (Terraform) for Databricks and cloud data platforms.
• Collaborate with cross-functional teams on security, data governance, and cloud architecture alignment.
• Provide technical leadership, mentoring, and solution oversight for data engineering teams.
Preferred Qualifications:
• Databricks certifications (Data Engineer Professional, Lakehouse Architect).
• Experience with streaming systems (Kafka, Event Hubs, Kinesis).
• Exposure to MLflow and operationalizing ML workloads.
Company Description:
At Mastech Digital, we solve meaningful business problems using data, AI, and modern digital technologies. Our teams work closely with global enterprises to build solutions that create real, measurable impact.
We bring deep industry expertise across Utilities & Energy, Financial Services, Healthcare, Retail, and Technology. With an AI-first mindset and a collaborative culture, we empower our people to innovate, grow, and help clients move forward with confidence.