Outcold Solutions - Monitoring Kubernetes, OpenShift and Docker in Splunk
Kubernetes Search in Splunk Monitoring Docker in Splunk Monitoring Kubernetes in Splunk Monitoring OpenShift in Splunk Monitoring Linux in Splunk Monitoring Windows Containers in Splunk Forwarding Logs to Elasticsearch and OpenSearch Forwarding Logs to QRadar
Documentation Blog Contact Us Careers Upload support diagnostics Pricing Evaluation licenses Partners License Agreement Privacy Policy Refund & Cancellation Acceptable Use Policy FAQ

Engineering

Senior Software Engineer

Full-time Remote - Florida residents $100k - $300k base + 10% bonus
Apply by email How we hire

About the role

We are looking for an experienced software engineer to join Outcold Solutions. We are a small, independent company, and you will work across the whole product with the founder and the rest of the team: the Collectord agent, the Splunk apps, the services behind them, and everything our customers read and watch.

This is a systems engineering role first. Collectord runs on every node of a customer’s cluster, on Linux and Windows, in environments we do not control. It has to be correct under rotation, restarts, and backpressure, cheap on CPU and memory, and easy to reason about when something goes wrong at three in the morning in someone else’s data center. If that kind of problem appeals to you, read on.

What you will do

  • Design, build, and maintain Collectord in Go: log tailing, metrics collection from cgroups and /proc, Kubernetes API watchers, and the output pipelines to Splunk, Elasticsearch, and OpenSearch.
  • Work close to the operating system on both Linux and Windows: container runtimes, filesystems, process and cgroup accounting, and the behaviors that differ between the two.
  • Build and extend our Splunk apps: dashboards, alerts, custom search commands, and React setup pages. Experience with a similar platform such as Elasticsearch, OpenSearch, Grafana, or Datadog is equally welcome.
  • Work with data at rest: embedded SQLite in the agent, Athena over telemetry, and the Splunk indexes our dashboards search.
  • Write JavaScript and TypeScript where the product needs a user interface, and keep it small.
  • Write the documentation, release notes, and blog posts for what you ship. Record screencasts and build demos.
  • Help customers: reproduce their environments, answer support requests, and fix root causes. Take part in an occasional on-call rotation.
  • Represent the company at conferences a few times a year.

What we are looking for

You do not need to check every box. If you are strong in most of these and curious about the rest, we want to hear from you.

  • A track record of shipping and operating production software, with the scars to show for it.
  • Fluency in Go, or deep experience in another systems language such as Rust, C, or C++ and the willingness to work in Go every day.
  • A working understanding of Linux internals: processes, cgroups, namespaces, filesystems, signals, and networking. Familiarity with the Windows equivalents is a plus.
  • Hands-on experience running Kubernetes, OpenShift, or Docker in production, and an understanding of how logs and metrics actually flow through them.
  • Comfort with SQL and with the trade-offs of embedded and analytical databases.
  • Experience with Splunk or a comparable log and metrics platform: how data is indexed, searched, and visualized.
  • Enough JavaScript to build and maintain a modest web interface without a large framework.
  • Clear written communication. Much of our work reaches customers as documentation, and you will write a lot of it.
  • The habit of measuring before deciding, and of proving a change with a test before calling it done.

Nice to have

  • Contributions to open source projects in the Kubernetes, container, or observability ecosystems.
  • Experience with AWS Lambda, CloudFormation, or metered billing systems such as Stripe.
  • Experience giving talks, recording videos, or writing for a technical audience.
  • Familiarity with FIPS or other compliance requirements for shipped binaries.

How we work

  • Small team, no hand-offs. You own a change from the first design note to the support ticket it eventually generates.
  • Every change is tested. Unit tests run in containers, and integration suites bring up real Kubernetes clusters and real Splunk, Elasticsearch, and OpenSearch instances.
  • We write things down. Design notes, README files, and release notes are part of the work, not an afterthought.
  • Asynchronous by default, with a few synchronous conversations a week. We respect focused time.

Location and travel

This is a remote position open to residents of Florida. There is no office to report to, and where you work from day to day is your call. Our home base is DeLand, near Orlando, and we meet in person when it is useful.

You must be authorized to work in the United States. We are not able to sponsor visas at this time. We participate in E-Verify and confirm employment eligibility for every new hire.

Expect to travel a few times a year to conferences such as Splunk .conf, KubeCon, and Red Hat Summit, with the company covering travel.

Compensation and benefits

  • Base salary from $100,000 to $300,000 a year. The range is wide on purpose: where an offer lands depends on the scope you can own from day one, and we would rather say so than hide it.
  • An annual bonus with a 10% target, based on company and individual performance.
  • Medical, dental, and vision insurance.
  • 401(k) retirement plan.
  • Flexible time off with no fixed cap.
  • Remote work, with no office to report to.
  • Conference travel, with the company covering the trip.

How to apply

Send an email to careers@outcoldsolutions.com with the subject “Senior Software Engineer”. Include a resume or a link to your profile, and a short note about something you have built or debugged that you are proud of. Links to code, talks, or writing help us more than a cover letter.

Here is what to expect:

  1. We read every application and reply within a week.
  2. A conversation about your background and the role, about an hour.
  3. A take-home exercise, scoped to a few hours and close to the work you would actually do.
  4. A technical conversation about your solution and a real problem from our codebase. No whiteboard puzzles.
  5. A final conversation about how we would work together, and an offer.

If you need an accommodation at any stage of the process, tell us and we will make it work.

Equal opportunity

Outcold Solutions is an equal opportunity employer. We welcome applications from people of every background and make hiring decisions on the basis of qualifications, merit, and business need, without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, pregnancy, marital status, or any other characteristic protected by law.

About Outcold Solutions

Outcold Solutions provides solutions for monitoring Kubernetes, OpenShift and Docker clusters in Splunk Enterprise and Splunk Cloud. We offer certified Splunk applications, which give you insights across all container environments. We are helping businesses reduce complexity related to logging and monitoring by providing easy-to-use and easy-to-deploy solutions for Linux and Windows containers. We deliver applications, which help developers monitor their applications and help operators keep their clusters healthy. With the power of Splunk Enterprise and Splunk Cloud, we offer one solution to help you keep all the metrics and logs in one place, allowing you to quickly address complex questions on container performance.

Red Hat
Splunk
AWS