Solutions/Databricks Architect

PCI Professional Services is seeking a Solutions/Databricks Architect for an upcoming opportunity. This role is remote and reports to the Program Manager. The ideal candidate will be a technical leader with deep expertise in Databricks, cloud data architectures, and modern data engineering practices.

• Design and implement scalable data lakehouse architectures using Databricks for federal data solutions.
• Develop and optimize end-to-end data pipelines, ensuring alignment with federal performance, security, and compliance requirements. Implement data governance and security protocols in accordance with federal standards (e.g., FedRAMP, FISMA, NIST, etc.).
• Collaborate closely with federal stakeholders to gather and analyze requirements and translate them into actionable data solutions. Lead efforts to integrate Databricks with federal cloud services, including AWS GovCloud, Azure Government, or other federal platforms.
• Provide subject matter expertise on Databricks capabilities, including Delta Lake, Databricks SQL, and Apache Spark.
• Optimize Databricks clusters for cost efficiency, high availability, and performance in a secure environment.
• Enable advanced analytics and machine learning workflows for federal use cases, leveraging tools such as MLflow and related frameworks.
• Develop and implement real-time data processing solutions for mission-critical federal applications.
• Stay updated on federal data policies and ensure solutions align with relevant standards and compliance requirements.