Databricks Data Engineer
Tasks
- Assess and improve security controls
- Build and configure Databricks workspace
- Design and implement data ingestion pipelines
- Develop data dictionaries and SOPs
- Implement Unity Catalog for data governance
- Implement documentation and architecture diagrams
- Integrate enterprise data sources
- Maintain data lineage and metadata
- Normalize and prepare data for downstream use
Perks/Benefits
Skills/Tech-stack
AWS | Active Auditing | Airflow | Azure | CI/CD | Data Governance | Data Optimization | Databricks | Databricks Workflows | Delta Lake | End to End | End to End Lineage | Git | Infrastructure as Code | MLflow | Metadata Management | PySpark | Python | Schema evolution | Spark SQL | Time Travel | Unity Catalog | “as-code”
Education
Bachelor of Arts | Bachelor of Science | Master of Arts | Master of Science
Roles
Related jobs
-
Cloud infrastructure | Distributed Systems | GPU | JAX | Machine LearningMid-level Full TimeUnited States R9h ago
-
LLM Application Engineer USD 130K-175KAPIs | Agent Frameworks | Databases | Distributed Systems | EvaluationMid-level Full TimeUnited States R9h ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Kafka | Automated Ingestion | AzureConference presentations | Hackathons | Mentorship | Remote work | Training programsSenior-level Full TimeUnited States R11h ago
-
Machine Leaning Performance Engineer (Inference) USD 200K-300KC++ | CUBLAS | CUDA | CUDA C | CutlassFitness Events | Free meals | Hybrid work options | Paid time off | Volunteer opportunitiesMid-level Full TimeNew York R12h ago
-
Machine Learning Research Engineer USD 200K-300KAI Agents | API Design | Automation | Dask | Data pipelineHybrid work | Paid time off | Paid wellness expenses | Volunteer opportunities | Workshops and continuous learningMid-level Full TimeNew York R12h ago
-
General Pipeline - FullStack Applied AI Engineer USD 150K-250KAWS | Access Control | Asynchronous programming | Authentication | AuthorizationSenior-level Full TimeUnited States R14h ago
-
Agent Orchestration | Agentic AI | Apache Airflow | Argo Workflows | Artifact versioning401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R14h ago
-
Senior Software Engineer (Data & AI Solutions) USD 125K-156KAWS | Apache Airflow | Apache Spark | BAM | Bioinformatics401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R14h ago
-
Staff Software Engineer, Backend (Online Storage) USD 230K-290KAWS | Capacity Planning | Database Benchmarking | Disaster Recovery | Distributed SQLDental and vision coverage | Employee stock purchase plan | Flexible spending wallets | Health care coverage | Remote work flexibilitySenior-level Full TimeRemote US R16h ago
-
A/B | A/B Testing | API Integration | Airflow | Attribution ModelingCross-functional collaboration | Remote workSenior-level Full TimeUnited States R16h ago
-
Senior Embedded Engineer- Developer Experience USD 130K-179KBLE | Bluetooth Low Energy | C# | CI/CD | CMakeSenior-level Full TimeRemote, Seattle, Washington, United States R16h ago
-
Data Engineer USD 170K-209KAWS | Amazon Kinesis | CI/CD | Compliance Frameworks | Container OrchestrationSenior-level Full TimeUS - Remote; Canada - Remote R17h ago
-
Junior Data Engineer (New York, NY) USD 62K-83KAWS CDK | AWS CloudFormation | Apache Hive | Apache Spark | Continuous DeploymentHealth benefits | Paid time off | Professional development | Remote-first workplaceEntry-level Full TimeNew York City, NY metro area R17h ago
-
Junior Data Engineer (Philadelphia, PA) USD 62K-75KAWS CDK | AWS CloudFormation | Apache Hive | Apache Spark | Data pipeline403b match | Flexible work environment | Medical, vision, and dental coverage | Paid community service time | Paid parental leaveEntry-level Full TimePhiladelphia, PA metro area R17h ago
-
Senior AI Systems Engineer – LLM & Agentic Systems USD 140K-160KAWS | Agentic AI | Alerting | Drift Detection | EmbeddingsDaily group classes | Dry cleaning benefits | Free onsite fitness center | Free shuttle transportation | Gourmet cafeteriaSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R18h ago
-
Data Engineer I USD 80K-110KAnalysis Services | Azure Data | Azure Data Factory | Azure DevOps | Azure MonitorHybrid work scheduleMid-level Full TimeRifle, Colorado, United States; Grand Junction, … R18h ago
-
Data Warehouse Software Engineer USD 70K-80KApache Airflow | Cloud Composer | Cloud platform | Git | Google BigQuery401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeSomerville, Massachusetts, United States R18h ago
-
Senior Database Engineer USD 114K-195KAWS CloudFormation | AWS RDS | Access Control | Always On | Always On AvailabilitySenior-level Full TimeUS Remote R19h ago
-
Data Engineer USD 140K-348KDBT | Dagster | Data Architecture | Data Modeling | ETLCell phone reimbursement | Company recharge days | Flexible PTO | Health, dental and vision coverage | Home internet reimbursementMid-level Full TimeSan Francisco, CA • New York, … R19h ago
-
Senior, ML Engineer - 3D Reconstruction USD 177K-212KActive Learning | CI/CD | Cloud services | Deep learning | Docker401k match | AD and D insurance | Company holiday closures | Flexible schedule | Life insuranceSenior-level Full TimeAnn Arbor, MI, Remote - US R19h ago
-
Senior IT DataOps Business Intelligence Engineer USD 143K-185KAccess Control | Amazon Web Services | Anthropic | CI/CD | Census401k | Dental insurance | Education and learning stipend | Flexible vacation time | Health insuranceSenior-level Full TimeNew York City R20h ago
-
Senior Site Reliability Engineer - Storage USD 267K-356KAlertmanager | Amazon S3 | Ansible | ArgoCD | BuildkiteSenior-level Full TimeSan Francisco Office (Fremont St) R20h ago
-
Senior Machine Learning Engineer, Fraud Detection USD 185K-225KA/B | A/B Testing | API | AWS | AWS SageMaker401k match | Commuter benefit | Dental insurance | Flexible spending account | Flexible time offSenior-level Full TimeLos Angeles, California, United States; San … R20h ago
-
Staff Software Engineer - Experimentation USD 265K-331KAWS | CI/CD | Cloudflare | DBT | Data Pipelines13 paid holidays | 16-week parental leave | 401k | Carrot Fertility Membership | Carrot fertility reimbursementSenior-level Full TimeRemote R20h ago
-
Senior AI Engineer USD 120K-160KAWS | Benchmarking | Databricks | FastAPI | Flask401k Safe Harbor Plan | Bounty programs | Certification reimbursement | Free health insurance | Generous PTOSenior-level Full TimeSchenectady, New York, United States, Remote R20h ago