Data Platform Engineer
Tasks
- Build CI pipeline
- Build Databricks workflows
- Collect and analyze project activity data via APIs
- Develop and maintain Databricks notebooks
- Establish merge request standards
- Integrate GitLab and Confluence
- Integrate GitLab and JIRA
- Maintain GitLab Databricks integrations
- Manage GitLab repository standards
- Perform code reviews
- Resolve missing Python library dependencies
- Support research and evaluate new features
- Troubleshoot access control issues
Perks/Benefits
Skills/Tech-stack
CI/CD | Confluence | Databricks | Databricks Notebooks | DevSecOps | GitLab | Jira | Python | REST API
Education
N/A
Related jobs
-
Data Engineer/Sr Data Engineer, IT Analytics USD 38K-55KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake401 k program | Dental insurance | Discounts | Employee assistance program | Health benefitsSenior-level Full TimeFort Worth, TX, US4h ago
-
Active Learning | Calibration | Causal Inference | Constrained optimization | Contextual BanditsSenior-level Full TimeAustin, TX10h ago
-
Staff Machine Learning Engineer USD 165K-236KClass imbalance | Docker | Error Analysis | Feature Engineering | Feature Labeling401k | Bonus | Equity | Generous vacation time | Medical/Dental/Vision insuranceSenior-level Full TimeRemote USA R10h ago
-
Dynamic Scheduler DSP Algorithm Engineer USD 125K-175KCombinatorial Optimization | Convex Optimization | MATLAB | Optimization Solvers | PythonMid-level Full TimeLanham, Maryland, United States11h ago
-
AWS | Azure | CI/CD | Container Networking | Container networking interface401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R11h ago
-
AWS | Azure | CI/CD | Container Networking | Containers401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R11h ago
-
Principal Software Engineer- Embedded OS USD 125K-150KAgile | Artifactory | Atlassian Bamboo | Atlassian Confluence | BSPCareer growth opportunities | Comprehensive benefits | MentorshipSenior-level Full TimeDenver, Colorado, United States12h ago
-
Senior-level Full TimeDenver, CO - Hybrid; New York, … R12h ago
-
Staff+ Software Engineer, Safeguards Data USD 320K-485KAWS | Access Control | Cloud platform | Data Governance | Data LineageFlexible working hours | Generous vacation | Hybrid office policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R12h ago
-
Software Engineer, Applied AI USD 170K-300KAWS | Agents | Benchmarking | Datadog | ECSFree coachingSenior-level Full TimeNew York R13h ago
-
Senior Solution Engineer USD 138K-181KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricTravel opportunitiesSenior-level Full TimeUS-GA-Remote R13h ago
-
Senior Robotics Software Engineer, Behaviors USD 220K-292KAgent coordination | Behavior Trees | BehaviorTree.CPP | C++ | Embedded SystemsHealth benefits | Recovery Benefits | Travel opportunitySenior-level Full TimeCosta Mesa, California, United States13h ago
-
Senior Database Engineer USD 130K-150KAWS | AWS CDK | AWS CloudFormation | Access Control | Amazon AuroraSenior-level Full TimeLas Vegas, Nevada, United States; Seattle, … R13h ago
-
Embedded Software Engineer USD 100K-135KAgile | Bare Metal | Bash | C# | C++401k match | Employee support resources | Flexible Rewards Program | Flexible time off | Gym membershipsMid-level Full TimePittsburgh, PA13h ago
-
Sr. Manager, Data Platform Engineering USD 171K-228KAPI Integration | AWS | Access Control | Amazon S3 | Apache IcebergEmployee resource groups | Free home security system and monitoring | Hybrid work modelSenior-level Full TimeBoston, MA R13h ago
-
Software Engineer, Data Products & Platform USD 170K-300KAWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatch | Amazon S3Work with coachesSenior-level Full TimeNew York R14h ago
-
Machine Learning Engineer USD 150K-250KLanguage Processing | Machine Learning | Natural Language | Natural Language Processing | PyTorchOpen source portfolio | Publications in ML venues | Startup experience | Understanding model failures in the wild | Visa sponsorshipMid-level Full TimeToronto Hybrid R14h ago
-
Data Analyst/BI Engineer USD 85K-110KAmazon S3 | Apps Script | Azure | BigQuery | Data Lineage401k match | Dental insurance | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States R14h ago
-
Software Engineer, Fulfillment Core Services USD 128K-160KAPI Integration | AWS | Buildkite | CI/CD | CircleCI401k company match | Childcare benefits | Commuter benefits | Dental insurance | Family building benefitsEntry-level Full TimeSeattle, WA R15h ago
-
Mid-level Full TimeSanta Ana, California, United States15h ago
-
Software Engineer, Data Infrastructure USD 155K-185KAWS | Access Control | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeMountain View, CA15h ago
-
Senior Analytics Engineer USD 113K-125KChurn analysis | Customer Lifetime Value | DBT | Data Architecture | Data Modeling401k matching | Dental insurance | Employee assistance program | Employer Paid Short-term Disability | Flexible time offSenior-level Full TimeDallas-Fort Worth Metroplex; Denver Metropolitan Area R16h ago
-
Junior AI Engineer - Onsite USD 54K-60KAPI | Anthropic | Docker | JSON | JavaScriptOnsite work locationEntry-level Full TimeGrand Rapids, Michigan16h ago
-
AI Engineer - On Site USD 65K-87KAPI | Automation | Billing automation | Compliance Automation | ConnectwiseEntry-level Full TimeGrand Rapids, Michigan16h ago
-
Data Engineer II (Remote US) USD 94K-118KAlerting | BigQuery | Clustering | Common table expressions | Cost Management401k matching | Annual learning budget | Dental insurance | Employee resource groups | Health insuranceMid-level Full TimeRemote - U.S. R16h ago