What You'll Be Owning:
As a Data Lakes Engineer you will be responsible for full-stack databricks platform administration designing scalable storage, ETL, and transformation workflows.
What Would You Must Have:
-
TS/SCI Security Clearance Required
-
Master’s degree or higher (e.g., Ph.D.) in Computer Science, Information Technology, Systems Engineering, Data Science, Business Administration, Engineering Management, or a closely related field; or a minimum of 11+ years of experience managing complex technical projects in enterprise data architecture, Databricks administration, and cloud-based data platforms.
-
Knowledge and capability to support Data Lake platform administration and enterprise data architecture for DoD data-driven projects.
-
Skilled in Data Lake platform administration, including workspace management, cluster optimization, Unity Catalog integration, and cloud integration for secure data governance.
-
Proficient in data pipeline development (ETL/ELT), Delta Lake architecture, Data Lakehouse optimization, and AI/ML workflow integration for DoD analytics and mission-critical data workflows.
-
Experienced in SysEngOps, DevSecOps, version control systems (Git), and CI/CD pipelines to streamline Data Lake development and deployment.
-
Knowledgeable in identity and access management (IAM), role-based access control (RBAC), and cloud security best practices across AWS, Azure, and GCP.
-
Hands-on expertise in Python, SQL/NoSQL, Apache Spark, Databricks SQL, Terraform, and cloud-native data services for large-scale data processing and analytics.