Lead Software Engineer - Data Engineer
Jersey City, NJ, United States
USD 170K-185K (estimate) Senior-level Full Time
Tasks
- Automate remediation of recurring issues
- Build Spark based ETL ELT pipelines
- Design and develop data engineering solutions
- Develop and debug production Python PySpark code
- Ensure data pipeline operational stability
- Evaluate vendor and startup architectures
- Implement secure coding and peer review
- Lead proof and adoption of AI assisted engineering practices
- Maintain and optimize lakehouse tables and metadata
- Optimize Spark SQL queries and execution plans
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWS | AWS Glue | AWS Glue Data Catalog | AWS S3 | Apache Iceberg | Apache Kafka | Apache Spark | Automated testing | CI/CD | Cause analysis | Compaction | Continuous Delivery | Data Catalog | Databricks | ELT | EMR | ETL | Glue Data Catalog | Iceberg | Incident Troubleshooting | Java | Kafka | Metadata Management | PySpark | Python | Root Cause Analysis | Root cause | SQL | Schema evolution | Small File Mitigation | Snapshot Retention | Spark SQL | Spark Structured Streaming | Streaming ETL | Structured Streaming | Table Partitioning | Test strategy
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Software Engineer | Software Engineer
Regions
Countries
States
Cities
Related jobs
-
C++ | Caffe | Deep and Wide | Deep learning | GBDTMid-level Full TimeSeattle, Washington, United States3h ago
-
C++ | Computer Vision | Data Mining | Deep learning | GoEntry-level Full TimeSan Jose, California, United States3h ago
-
Big Data | Data Modeling | Data Processing | Data Warehousing | Data analyticsDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States3h ago
-
Algorithms | C++ | Computer Vision | Data Mining | Data StructuresEntry-level Full TimeSeattle, Washington, United States3h ago
-
Low Power Design Methodology and Optimization Engineer USD 192K-278KANSYS | C# | C++ | CPU Benchmarking | CPU microarchitectureSenior-level Full TimeAustin, TX, USA4h ago
-
AWS Data Engineer USD 91K-155KAgile | Amazon Elastic Container Service | Amazon Web Services | Apache Airflow | Apache SparkRemote workSenior-level Full TimeMadrid, MD, Spain5h ago
-
API Integration | APIs | Agent systems | Apache Spark | AutomationInternal talks | Learning platform | Remote days | Sports classes | Wellness benefitsEntry-level Full TimeBrooklyn, United States R5h ago
-
Senior Data Engineer, Databricks USD 119K-145KApache Spark | Asset bundles | Auto Loader | Azure Data | Azure Data Factory401k company match | Accrued vacation time off | Dental insurance | Long-term disability | Medical insuranceSenior-level Full TimeDENVER, CO, US10h ago
-
Lead Infrastructure Engineer - Public Cloud Storage USD 119K-196KAccess Management | Block Storage | Cloud Compliance | Cloud Governance | Cloud Networking401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …15h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 190K-252KAnomaly Detection | Bayesian Filtering | Big Data | C# | C++Health benefits | Recovery BenefitsSenior-level Full TimeFort Collins, Colorado, United States17h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Senior-level Full TimeWashington, District of Columbia, United States17h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Competitive benefits | Employee assistance program | Health insurance | Recovery BenefitsSenior-level Full TimeWaltham, Massachusetts, United States17h ago
-
Software Engineer, Robotics Tracking and Fusion USD 165K-218KAnomaly Detection | Bayesian Filtering | C# | C++ | ClassificationHealth benefits | Paid time off | Recovery Benefits | Relocation assistance | U S Top Secret clearance supportMid-level Full TimeFort Collins, Colorado, United States17h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee benefits | Health and Recovery Support | Health benefits | Paid time offMid-level Full TimeWashington, District of Columbia, United States17h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee assistance | Flexible time off | Health benefits | Recovery supportMid-level Full TimeWaltham, Massachusetts, United States17h ago
-
Lead Machine Learning Engineer USD 139K-304KAI Services | Agile | Azure AI | Azure AI Services | Azure Container401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States18h ago
-
Site Reliability Engineer III - Machine Learning USD 185K-215K.NET | Argo CD | Black box monitoring | Black-box | C SharpSenior-level Full TimeWilmington, DE, United States1d ago
-
Behavior planning | C++ | Computer Vision | Control Systems | IMUEquity compensation | In-office work schedule | Relocation assistance | Visa sponsorship for transfersSenior-level Full TimeSan Francisco, California, United States1d ago
-
Agentic Workflows | Automation | Data integration | Enterprise Integration | GenAIMedical/Dental/Vision insurance | Unlimited PTO | Wellness stipendMid-level Full TimeSan Francisco, California, United States1d ago
-
Common table expressions | Compiled SQL Table Functions | DB2 SQL | Db2 Table Functions | Deterministic SQLHybrid work location flexibilitySenior-level Full TimeSeattle, Washington, United States R1d ago
-
AWS | Adversarial Machine Learning | Azure | Bias and fairness | C++401k profit sharing | Dental insurance | Education reimbursement | Employee referral incentive | Flexible spending accountsSenior-level Full TimeHuntsville, Alabama, United States1d ago
-
Consultant (LLM/AI Skillset) USD 110K-160KAPI Development | Agile | Language Models | Large Language Models | Machine LearningMid-level Full TimeDallas, Texas, United States1d ago
-
Agent systems | Enterprise Data | Fine Tuning | LLM Fine-tuning | Language ModelsRemote workSenior-level Full TimeAustin R1d ago
-
Staff Manufacturing Engineer, Robotics USD 128K-160KAssembly processes | Automation | Cause analysis | Controls engineering | DFADental and vision insurance covered | Health insurance premiums covered | Healthcare premiums for dependents supported | Paid parental leave | Paid time offSenior-level Full TimeWeirton, WV1d ago
-
Senior Data Analytics Engineer USD 175K-214KBusiness Intelligence | Dashboard Development | Data Engineering | Data Pipelines | Data QualitySenior-level Full TimeSan Francisco, CA1d ago