Lead Software Engineer
Jersey City, NJ, United States
USD 177K-215K (estimate) Senior-level Full Time
Tasks
- Architect data lakehouse
- Build batch and streaming pipelines
- Design data ingestion and processing layers
- Enforce data governance security controls
- Implement CDC ingestion
- Implement infrastructure as code with Terraform
- Maintain data pipelines
- Manage Delta Lake tables
- Monitor data platform reliability
- Perform incident response and RCA
- Productionize Databricks workloads
- Run design reviews and mentor engineers
- Set up CI CD for environment promotion
- Translate stakeholder needs into technical plans
- Tune Spark performance
- Write unit and integration tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS IAM | AWS KMS | AWS S3 | AWS VPC | Alerting | Apache Spark | CI/CD | Cause analysis | Checkpointing | Data Governance | Data Lineage | Data Quality | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Idempotency | Infrastructure as Code | Monitoring | Root Cause Analysis | Root cause | SLA | SLO | Structured Streaming | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Cities
Related jobs
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R21h ago
-
API Integration | AWS Bedrock | Auditing | Authentication | AuthorizationMentoring | MentorshipMid-level Full TimeMenlo Park, CA, United States21h ago
-
Lead Palantir AI and Data Science Engineer II USD 159K-265KAI workflows | Analytics | Cloud Computing | Dashboards | Data GovernanceProfessional development | Travel opportunitiesSenior-level Full TimeRosslyn, Virginia, United States1d ago
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States1d ago
-
Senior Software Engineer, Google Cloud Dataproc USD 174K-252KApache Hive | Apache Spark | C++ | Data Warehouse | Data Warehouse InternalsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Analytics Data Engineer USD 94K-130KAzure Data | Azure Data Factory | CI/CD | Data Analysis | Data FactoryRemote workMid-level Full TimeFlagstaff, AZ, US1d ago
-
AI Application & Cloud Operations Engineer (Mid level) USD 108K-117KAWS | AWS Bedrock | AWS CloudTrail | AWS CloudWatch | AWS PrivateLinkMid-level Contract Full TimePlano, TX, United States1d ago
-
Staff Data Engineer USD 147K-184KAmazon Kinesis | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache SparkDental insurance coverage | Health insurance coverage | Paid parental leave | Paid vacation | Relocation assistanceSenior-level Full TimeBerkeley, CA1d ago
-
Associate, Client Intelligence (Data Scientist) USD 98K-132KAWS | Apache Spark | Azure | Big Data | Cloud platformEmployee resource groups | Matching gift program | Professional development | Sustainability and Climate Change Initiatives | Volunteerism programMid-level Full TimeNew York, NY, US, 100011d ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Aiohttp | Angular | Asyncio | Azure DatabricksRemote work | USPS Public Trust Clearance supportMid-level Full TimeWork from home, VA, United States1d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R1d ago
-
AIOps | Anomaly Detection | Anthos | CRD | Control Plane401k plan | Basic life insurance | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeResearch Triangle Park, North Carolina, United … R1d ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R1d ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R1d ago
-
Senior Embedded Software Engineer, Linux USD 154K-230KC# | C++ | CI/CD | Cross-compilation | Device DriversLearning and development stipend | PTO | Parental leave | Sick leaveSenior-level Full TimeLong Beach, California, United States1d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R1d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R1d ago
-
AI Engineer USD 143K-210KAPI Integration | Audit trails | Authentication | CI/CD | Cost Optimization401k match | Casual work environment | Catered lunch | Comprehensive health insurance | Disability insuranceMid-level Full TimeLivingston, NJ / New York, NY …1d ago
-
AI/ML Engineer USD 152K-220K3D Reconstruction | 3D Scene | 3D Scene Understanding | AI Agents | Cloud ComputingAgile team collaboration | Fully remote | Production monitoring ownershipMid-level Full TimeSan Francisco, CA (Hybrid) or United … R1d ago
-
Data Engineer USD 150K-250KAWS | Business Intelligence | DBT | Data Governance | Data LineageGrowth opportunities | Ownership | Startup environmentMid-level Full TimeSan Francisco1d ago
-
Site Reliability Engineer - Data, Apple Ads USD 170K-264KAWS | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkEntry-level Full TimeAustin1d ago
-
Machine Learning Evaluation Engineer USD 130K-240KCause analysis | Computer Vision | Data Analysis | Data Augmentation | Data PipelinesMid-level Full TimeSunnyvale1d ago
-
AWS | Agentic Workflows | CI/CD | Concurrency | DevOpsSenior-level Full TimeSunnyvale1d ago
-
Senior AI Data Science Engineer USD 142K-200KAirflow | Annotation Workflow | Anomaly Detection | Cloud Data | Cloud Data PlatformsSenior-level Full TimeSunnyvale, CA, United States1d ago
-
AWS Bedrock | AWS CloudTrail | AWS CloudWatch | AWS PrivateLink | Bash401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceMid-level Contract Full TimePlano, TX, United States1d ago