Software Engineer, On Device

Utilidata
Ann Arbor, MI
Utilidata is a fast-growing NVIDIA-backed edge AI company enabling greater visibility and control of power utilization in energy-intensive infrastructure, like the electric grid and data centers. Karman, the company’s distributed AI platform powered by a custom NVIDIA module, is transforming the way utility companies operate the grid edge and will enable data centers to unlock more compute for the same provisioned power.

We are expanding our engineering team and looking for a Software Engineer to support the productionalization of our IoT platform, with a primary emphasis on the software that runs on edge IoT devices. This edge software includes machine learning, optimization algorithms, and components that host these capabilities that must meet high standards of performance, security, reliability, and accuracy. We are looking for candidates who are mission-driven, collaborative, adaptive and experienced in designing, writing, testing, and debugging distributed enterprise software at scale. Ideal candidates will possess knowledge of Python, Linux, continuous integration and deployment (CI/CD), with direct experience designing and developing successful enterprise software.

Responsibilities
  • Design, propose, plan, implement, and test resource-constrained, edge software in Python (and possibly lower-level languages, e.g., Rust) including the implementation of precision telemetry collection, real-time control interfaces, and robust system observability
  • Create and maintain CI/CD processes as necessary to support development and deployment with a focus on reproducibility, regression testing for embedded systems, and deployment in real-world, intermittently connected environments
  • Contribute to internal and external technical documentation
  • Collaborate with a cross-functional team of software, hardware, quality assurance (QA), and power systems engineers; data scientists; and leadership
  • Provide high-quality, in-depth code and architecture reviews, implement new features, and provide technical leadership while coordinating with project management, QA, and other internal teams
  • Continually advocate for and implement process improvement and automation
  • Foster a culture of open communication, innovation, and continual improvement
  • Mentor other engineers using paired programming, code review, and collaborative test scenario design
Minimum Qualifications
  • 5+ years of professional experience including 3+ years of experience developing production software and systems, or a combination of educational and professional experience commensurate with this level of experience
  • Demonstrated ability to design and implement distributed systems utilizing microservices in a resource-constrained environment (edge devices with limited memory, CPUs, GPU capacity, etc.)
  • Extensive experience using Python, C/C++, Rust, and the Linux operating system
  • Experience with device layered security, i.e. encryption (PKI) , disk partitioning, secure boot, os kernel libraries, device drivers, os processes/daemons
  • Data compression and schema management for device time series data
  • Experience implementing and maintaining CI/CD workflows (e.g., GitHub Actions or Jenkins)
  • Strong understanding of synchronous and asynchronous network communication, including REST APIs, gRPC, binary protocols, and distributed publish/subscribe messaging systems and protocols like MQTT and ZeroMQ
  • Strong written and oral communication skills, with a proven track record of working effectively both individually and as part of a team
Enhanced Qualifications (Nice to Have)
  • Experience designing, building and deploying applications and reusable libraries based on the NVIDIA ML software stack on the Jetson Platform
  • Experience with system integration testing including HIL and SIL
  • Understanding of SQL/NoSQL Database implementations (SQLite, Redis, Postgres, etc)
  • Well-versed in Docker/containerization
  • Hands-on knowledge of cloud platforms and services focused on IoT device management, security and OTA updates (AWS, Azure) preferably in the scale of million devices including managing release/versioning strategies and monitoring fleet-wide performance metrics
  • Experience with control systems applications (e.g. industrial processes, manufacturing, commercial buildings, SCADA) and/or power systems
  • Experience working with software and systems deployed in modern data center environments, including telemetry ingestion, rack-level integration, and coordination with orchestration platforms
  • Experience with Shell scripting, helm charts, ansible, and prometheus tools
Salary Range: $120,000 to $150,000 base compensation depending on experience and stock options. Salary will be commensurate with an individual's skills, training, years of experience, and in line with internal compensation bands.

Location: This position is based onsite at our company headquarters in Ann Arbor, Michigan, with flexibility for occasional remote work.

Our Commitments:
Utilidata values the diversity of our team. We provide equal employment opportunities without regard to race, color, religion, creed, sex, gender, sexual orientation, gender identity or expression, national origin, age, physical disability, mental disability, medical condition, pregnancy or childbirth, sexual orientation, genetics, genetic information, marital status, or status as a covered veteran or any other basis protected by applicable federal, state and local laws.

We are committed to:
  • Creating a diverse and inclusive workplace that is welcoming, supportive, affirming and respectful
  • Empowering employees to solve problems and work together to make a difference
  • Providing mentorship and growth opportunities as part of a collaborative team
  • A flexible work environment with flexible paid time off
  • Competitive compensation and benefits, including health, dental, vision, and employer-match 401k

Posted 2026-03-02

Recommended Jobs

Satisfy Your Career Goals and Meet Your Life's Desires.

MedSource Consultants
Michigan

(Physician/MD qualifications required) *Southwest MI - Enjoy a work life balance that will satisfy your career goals and meet your life's desires. *Opportunity for an Child and Adolescent Psychiatri…

View Details
Posted 2026-01-19

Customer Service Representative /Inside Sales

Galco Industrial Electronics
Madison Heights, MI

Galco Industrial Electronics, Inc., located in Madison Heights, Michigan, is a leading provider of industrial and commercial electrical and electronic controls, automation and motion products, repair…

View Details
Posted 2026-02-06

Insurance Agent - Life and Health

Summers Agency
Ypsilanti, MI

Build a Career, Not Just a Job   The Summers Agency is expanding and looking for individuals interested in starting or growing a career in insurance sales. This role offers flexibility, strong inc…

View Details
Posted 2026-02-24

MSE Assistant Principal 2026-2027 - SY

Taylor, MI

Region: 13 School District/Employer: District Category/Employer: Campus, Position: Assistant Principal, …

View Details
Posted 2026-02-25

R-159291 Part-time Nabisco Merchandiser/Order Writer

Mondelez International
Michigan

Part Time Nabisco Merchandiser/Order Writer   Join our team of Part Time Nabisco Merchandisers and fulfill the merchandising needs of our customers through communication & relationship building, st…

View Details
Posted 2026-02-10

Stitcher Folder Operator

Sheridan
Grand Rapids, MI

Job Description 3rd Shift - Stitcher/Folder Operator Company: Sheridan Grand Rapids Department: Bindery Reports To: 3rd Shift Production Supervis…

View Details
Posted 2026-03-03

Senior Level Professional Land Surveyor

Williams & Works
Grand Rapids, MI

We are seeking a Senior Level Professional Land Surveyor to join our team. This is a key departmental position with the expectation that the right candidate will assist with the management of the Surv…

View Details
Posted 2026-01-28

Remote Client Support Representative - Travel

Almaaventurera
Wyoming, MI

We are seeking a Remote Client Support Representative – Travel to assist clients throughout their travel journey. In this fully remote role, you will serve as a key point of contact for travelers, pr…

View Details
Posted 2026-02-23

Restaurant Assistant General Manager - Ann Arbor

Anna’s House
Ann Arbor, MI

Looking for a fun, fast-paced place to work? Enjoy working in the hospitality industry as a servant leader? Anna's House has an opportunity just for you! We are looking for a Restaurant Assistant …

View Details
Posted 2025-03-08

Machine Learning Engineer

Rocket
Detroit, MI

As a Machine Learning Engineer, you will design and develop the platforms and frameworks that facilitate automated data-driven decision-making, gather data, and determine statistical algorithms and mo…

View Details
Posted 2026-02-06