Steve Jones - sjramblings.io

Unleashing the power of AWS Athena on Transit Gateway Flow Logs

AWS Transit Gateway Flow Logs provide valuable insights into the traffic flowing through your network. However, analyzing this data can be challenging, especially if you have many logs to sift through. In this article, we will show you how to use AWS Athena to quickly ingest and query your Transit

Possibly the Greatest Log Insights CloudTrail Query Ever!

AWS CloudTrail has a wealth of information that often gets forgotten and unchecked. An experienced Cloud Engineer will regularly check the trail for any issues brewing that might get them woken up at 3 am! Victor Grenu posted the following tweet some months back, and ever since, it's just a

When Forking is not an option for your public git repos

I'm curious if this is an everyday use case, but I need to sync a public repo to our internal GitHub Enterprise instance. Forking is not an option because I'm going across domains and not within GitHub.com. My purpose is to enable a GitHub Action internally. I keep having

github

Github Runner ECS Authentication

Using this fantastic open-source project, we have enabled GitHub Actions using ephemeral self-managed runners on AWS SPOT. 💡Please head over to GitHub to check out and support their excellent work. However, one thing we have hit is docker hub limits when running multiple workflows that use containers. We are running

GitHub Actions - How did I not see that

This post is about a mistake I made that wasted a fair bit of time on my side until the folks over in Support set me straight :) The Issue We have been using GitHub Actions within the platform team on our Enterprise instance for some time. We are using the

Terraform, GitHub Actions & OIDC on AWS

I've posted here how to configure the OIDC AWS Provider & GitHub Enterprise integration; however, nothing is better than an example of it working, and this post covers just that! The Use Case We use the Terraform GitHub Provider to manage organisations within our GitHub Enterprise instance. More information on that

GitHub Actions - Resource not accessible by integration

This post will hopefully help anyone searching for the following error. RequestError [HttpError]: Resource not accessible by integration at /__w/_actions/actions/github-script/v3.1.0/dist/index.js:2137:23 at processTicksAndRejections (internal/process/task_queues.js:97:5) { Error: Unhandled error: HttpError: Resource not accessible by integration status:

aws

Up and running with AWS Network Firewall - Part 3

The third post in my series as I share my learnings with AWS Network Firewall. If you want to start at the beginning, check out part 1 here and part 2 here. Let's get into setting up an Inspection VPC across multiple Availability Zones! The Setup Building on the example

aws

Cloudformation FirewallPolicy UPDATE_FAILED

While I have a fond love for Cloudformation, sometimes I find myself banging my head against a wall when trying to get past an error. This time it's related to AWS::NetworkFirewall::FirewallPolicy. The Issue The policy associated with an AWS Network firewall can be configured in either DEFAULT_ACTION_

GitHub Actions AWS Authentication with OIDC for GitHub Enterprise

There are many blog posts about how to use GitHub Actions OIDC with AWS; however, they all refer to using Github.com and don't provide some easy steps if you are running your own GitHub Enterprise instance. Today I spent far too long working this out and likely annoying my

Up and running with AWS Network Firewall - Part 2

The second post in my series as I share my learnings with AWS Network Firewall. If you want to start at the beginning, check out part 1 here Let's get into setting up an Inspection VPC! The Setup To build our example, we start with the following. All VPCs are

aws

Up and running with AWS Network Firewall - Part 1

This post is the first in a series to share my learnings as I get to grips with AWS Network Firewall. See the second part here There are many use cases; however, in this series, I'll focus on the following. Inspection VPC This pattern will place the firewall between two

AWS Config Rules Blessed with Cloudformation cfn-guard Support!

They said it was coming, and here it is! Support for defining custom cfn-guard rules for AWS Config via Cloudformation. Build AWS Config rules using AWS CloudFormation Guard For some background on cfn-guard and AWS Config, check out this post. The magic has been enabled within Cloudformation here. We now

terraform

Using Semgrep to keep track of your communities style

Semgrep is a fantastic tool, as the website rightly states! Static analysis at ludicrous speed Find bugs and enforce code standards We use it in our open source community where standards are not just for code but also documentation which we wrap up in a style or contribution guide. The

packer

HashiCorp packer amazon-linux cracklib gotcha

While setting up packer for the first time in ages I found a little cracklib quirk when using amazon linux while following the instructions from the website. Let get into it! Packer setup HashiCorp has some great documentation here on getting started with packer. Install Packer | Packer - HashiCorp LearnPacker

aws

Getting started with cfn-guard

Update Link to offical AWS blog post here There are a fair few policy-as-code tools popping up these days. This post looks at getting start with cfn-guard to parse AWS Config Resource JSON outputs. Why Guard? The reason this one has peaked my interest is due to the native AWS

aws

Security Hub now supports Custom AWS Config Rules

AWS recently announced an integration that I'm a little excited about! AWS Security Hub now receives AWS Config managed and custom rule evaluation results This post provides a summary of what it looks like and a little about its potential. Some history For those that follow AWS service releases you'll

aws

When Enterprise IT systems migrate to AWS

So we've all seen the marketing slides.... * Company x saved 40% in infrastructure costs * Company y collapsed their monothlith into 40 Lambdas But what happens when an on-prem system that has humed its tune in the local Data Centre for years and the vendor has never even thought of a

aws

How to sync containers to AWS ECS the easy way

It's actually really easy to set this up using CodeBuild & Event Bridge all wrapped up in a Cloudformation Stack!

terraform

How to simplify your CI/CD with Makefiles

In this post I'll show examples of how a Makefile can be used to help others use your project and also simplify your CI/CD Terraform workflows.

aws

How to use cfn-guard with AWS Config

How to use cfn-guard with AWS Config. I'm not sure when but AWS Config now supports using Guard!

aws

Config Conundrum

Why is AWS Config costing so much in this account?

terraform

Build a Terraform Community Org on GitHub Enterprise

How-to build a Terraform Community Org on GitHub Enterprise

aws

AWS Managed Prefix Lists

How-to provide managed prefix lists for services that users can consume either manually or through automation using the an SSM Parameter Store hierarchy.

aws

AWS GP3 Volumes

AWS GP3 volumes have some great cost benefits for AWS customers!