Open source news and updates #91

{"value":"#### **November 22nd, 2021 - Instalment #91**\nNewsletter #91.\n\nThis week I feature eleven new open source projects, covering a diverse array of use cases. From securing your Kubernetes clusters, a couple of nifty [Amazon Neptune](https://aws.amazon.com/cn/neptune/?trk=cndc-detail) tools, a Python library that provides state-of-the-art distributed hyper parameter optimising, a sample NFT marketplace and more. This weeks Amazon Web Services community and Amazon Web Services content features topics including Amazon Web Services SAM, Bottlerocket, Babelfish, Apache Airflow, PartiQL, Suricata, Slurm, Apache Kafka, Amazon Web Services Amplify, PHP and more. We have lots of smaller updates in the Quick Updates section, so make sure you do not miss those as well as some fresh new videos to check out.\n\nFinally, as we approach re:Invent (next week) make sure you check out the extended Events section which includes the sessions to watch out for.\n\n###### **re:Invent 2021**\n\nIf you are going or attending virtually, there is plenty of great open source related sessions this year. Head down to the Events section where I have provided some of the highlights I think that should be on your list of sessions to watch/attend. Also, check the noticeboard to make sure you do not miss the best re:Invent party, After Dark.\n\n#### **Celebrating open source contributors**\n\nThe articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.\n\nSo thank you to the following open source heroes: Vu Dao, Álvaro Hernández, Justin Wheeler, Aditya Samant, Vlad Vlasceanu, Rolando Santamaria Maso, Ramy Nasreldin, Prasanna Tuladhar, Shiva Vaidyanathan, Brian Lazear, Lakshmikanth Pandre, Gary Stafford, Federico Garza Ramírez, Uma Ramadoss, Rene Brandel, Josiah Bjorgaard, Austin Cherian, Angel Pizarro, Joseph Keating, Blayze Stefaniak, David Salinas, Cedric Archambeau, Aaron Klein, and Matthias Seeger.\n\nMake sure you find and follow these builders and keep up to date with their open source projects and contributions.\n\n##### **Community noticeboard**\n###### **After Dark Party**\n\nIf you are attending re:Invent next week, then make sure you check out and sign up for the After Dark Party. Whilst sadly I will not be there, it promises to be a great evening of networking with peers. There will be beverages, appetisers, entertainment, swag and more! No presentations, no pitches, just fun!\n\nFind and more and ++[RSVP, here](https://aws-oss.beachgeek.co.uk/13n)++.\n\n##### **Latest open source projects**\n###### **syne-tune**\n\n++[syne-tune](https://aws-oss.beachgeek.co.uk/14d)++ this open source Python library provides state-of-the-art distributed hyperparameter optimizers (HPO) where trials can be evaluated with several backend options (local backend to evaluate them locally; SageMaker to evaluate them as separate SageMaker training jobs; another backend with fast startup times is also in the making). To help you get started, David Salinas, Cedric Archambeau, Aaron Klein, and Matthias Seeger have put together this blog post, ++[Run distributed hyperparameter and neural architecture tuning jobs with Syne Tune](https://aws-oss.beachgeek.co.uk/14e)++\n\n\n\n###### **amazon-neptune-gremlin-dotnet-sigv4**\n\n++[amazon-neptune-gremlin-dotnet-sigv4](https://aws-oss.beachgeek.co.uk/13q)++\nlast week we saw released a small, open-source library that enables Amazon Web Services SigV4 signing for connecting to [Amazon Neptune](https://aws.amazon.com/cn/neptune/?trk=cndc-detail) on Amazon Web Services with the TinkerPop .Net client. Repository contains sample code and documentation on how to use this.\n\n###### **amazon-neptune-jdbc-driver**\n\n++[amazon-neptune-jdbc-driver](https://aws-oss.beachgeek.co.uk/13t)++ this open source project provides read-only JDBC connectivity for the [Amazon Neptune](https://aws.amazon.com/cn/neptune/?trk=cndc-detail) service using SQL, Gremlin, openCypher and SPARQL queries. Repo contains how to get started with this as well as some sample code.\n\n###### **amazon-rds-init-cdk**\n\n++[amazon-rds-init-cdk](https://aws-oss.beachgeek.co.uk/13v)++ I always find code samples and projects a great way to learn how to use Amazon Web Services, and so this repository will show to support [Amazon RDS](https://aws.amazon.com/cn/rds/?trk=cndc-detail) instances initialisation using CDK and CloudFormation Custom Resources. Rolando Santamaria Maso, Ramy Nasreldin, and Prasanna Tuladhar also have put together this blog post, ++[Use Amazon CDK to initialize Amazon RDS instances](https://aws-oss.beachgeek.co.uk/13w)++ to provide further guidance on how to use this code.\n\n\n\n###### **K8s-SAProbe**\n\n++[K8s-SAProbe](https://aws-oss.beachgeek.co.uk/13z)++ this project from Jayden Aung should be on your list to checkout if you are working on Kubernetes and are looking for tools to help you secure your clusters. Jayden has helpfully put together this blog post, ++[SAProbe — A simple tool that discovers exposed Kubernetes Secrets via Service Accounts](https://aws-oss.beachgeek.co.uk/140)++\n\n###### **apigw-websocket-pusher**\n\n++[apigw-websocket-pusher](https://aws-oss.beachgeek.co.uk/14f)++ this project provides a fast and cost effective way for broadcasting messages to multiple users. Showing you how you can use this is the post, ++[Amazon Web Services API Gateway Websocket Asynchronous Notifications Pusher](https://aws-oss.beachgeek.co.uk/14m)++\n\n\n\n###### **s3-data-pump**\n\ns3-data-pump if you are looking for a way of moving large collections of S3 objects among buckets, then check out this open source project which you can use as the base for your own experimentation.\n\n\n\n###### **streaming-endpoint-for-apache-hbase**\n\n++[streaming-endpoint-for-apache-hbase](https://aws-oss.beachgeek.co.uk/14h)++ this project helps you create a custom Apache HBase replication endpoint, to stream records into Apache Kafka, [Amazon Kinesis](https://aws.amazon.com/cn/kinesis/?trk=cndc-detail) or others.\n\n###### **simple-nft-marketplace**\n\n++[simple-nft-marketplace](https://aws-oss.beachgeek.co.uk/14i)++ whilst personally I am still on the fence around the useful applications of NFTs, if you are looking to explore this area then you can try out this sample project that helps you build a simple NFT marketplace with [Amazon Managed Blockchain](https://aws.amazon.com/cn/managed-blockchain/?trk=cndc-detail).\n\n\n\n###### **azure-eventhub-consumer-with-dynamodb**\n\n++[azure-eventhub-consumer-with-dynamodb](https://aws-oss.beachgeek.co.uk/14n)++ if you are looking for some example code on how to build applications that span and integrate between Amazon Web Services and Microsoft Azure, then check this project that shows how you can consume events from Azure Event Hub, storing checkpoint and ownership information in a DynamoDB table, and saving all the event data to a S3 bucket and if needed, logging metrics for consumer latency to CloudWatch Metrics.\n\n\n\n###### **rekognition-video-people-blurring-cdk**\n\n++[rekognition-video-people-blurring-cdk](https://aws-oss.beachgeek.co.uk/14o)++ this sample project demonstrates how Amazon Web Services Step Functions can be used to orchestrate Amazon Web Services Lambda functions that call [Amazon Rekognition](https://aws.amazon.com/cn/rekognition/?trk=cndc-detail) for face detections, and use OpenCV to blur these detections per frame in the video. Check out the sample below.\n\n\n\n\n\n##### **Amazon Web Services open source project revisit**\nThis section will feature projects that may not be new, but are ones that you should probably check out.\n\n###### **awsudo**\n\n++[awsudo](https://aws-oss.beachgeek.co.uk/14s)++ this open source project from Meltwater is a simple utility for easily executing Amazon Web Services cli commands with an assumed role. Andy Desmarais has put together a blog post, Assuming roles in Amazon Web Services with sudo-like agility, to help you get started.\n\n##### **Amazon Web Services and Community blog posts**\n###### **Amazon Web Services Amplify**\n\nThe big news last week was the announcement that you can now add custom resources when using the Amplify cli that enables developers to add additional resources beyond Amplify’s built-in use cases.\n\nRene Brandel shared more details in his posts, ++[Extend Amplify backend with custom Amazon Web Services resources using Amazon Web Services CDK or CloudFormation](https://aws-oss.beachgeek.co.uk/143)++ and ++[Override Amplify-generated backend resources using CDK](https://aws-oss.beachgeek.co.uk/144)++ [hands on]\n\n\n\nWe also had a post from Nikhil Swaminathan and Eric Clemmons of the Amazon Amplify team, ++[Amplify UI’s new Authenticator component makes it easy to add customizable login pages to your React, Angular, or Vue app](https://aws-oss.beachgeek.co.uk/14k)++ walking you through the recently announced new version of the Authenticator component for JavaScript (JS)-based web apps, giving developers the easiest way to add login experiences to their app with a single line of code. [hands on]\n\n\n\n##### **Bottlerocket**\n\nA couple of Bottlerocket posts this week. First up we have Amazon Web Services Community Builder Vu Dao, who has been busy writing ++[Amazon Web Services BottleRocket On EKS NodeGroup](https://aws-oss.beachgeek.co.uk/14q)++ with a hands on guide on how to launch a Bottlerocket managed node group on EKS cluster.\n\nFollowing that we have a post from Ritesh Patel and Mikhail Shapirov on how to use Bottlerocket OS and Kyverno (an open source Kubernetes native policy engine) on [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail) managed by Nirmata Kubernetes Platform to help secure your Kubernetes environments. To find out more, read on in ++[Provisioning and Securing Bottlerocket OS-Based Amazon EKS Clusters Using Nirmata Kubernetes Platform](https://aws-oss.beachgeek.co.uk/14a)++ [hands on]\n\n\n\n##### **Amazon Web Services SAM**\n\nIn ++[Modernizing deployments with container images in Amazon Web Services Lambda](https://aws-oss.beachgeek.co.uk/148)++, Joseph Keating demonstrates how to use Amazon Web Services continuous integration and deployment (CI/CD) services, Amazon Web Services SAM and Docker to separate the container build process from the application deployment process of Lambda container images. [hands on]\n\n\n\n##### **Babelfish**\n\n++[Easily Running Babelfish for PostgreSQL on Kubernetes](https://aws-oss.beachgeek.co.uk/14r)++ Amazon Web Services Hero Álvaro Hernández shares how using StackGres 1.1.0, now includes Babelfish, making it easy to run Babelfish on Kubernetes. Do not worry if you are not super knowledgable on Kubernetes, Álvaro has you covered. Awesome stuff, and an essential read this week. [hands on]\n\n##### **Apache Kafka**\n\nAmazon Web Services Lambda now supports mutual TLS authentication for Amazon MSK and self-managed Kafka as an event source. This means you can provide a client certificate to establish a trust relationship between Lambda and MSK or self-managed Kafka brokers. To find out more, Uma Ramadoss provides a hands on guide to getting this going in ++[Introducing mutual TLS authentication for Amazon MSK as an event source](https://aws-oss.beachgeek.co.uk/141)++ [hands on]\n\n\n##### **PartiQL**\n\nIn the post, ++[Build faster with Amazon DynamoDB and PartiQL: SQL-compatible operations](https://aws-oss.beachgeek.co.uk/142)++ Pete Naylor and Akshat Vig show you how you can use PartiQL in DynamoDB to describe your data operations using SQL-compatible statements. PartiQL support in DynamoDB provides a familiar path so you can build faster, and also provides powerful new batched capabilities. [hands on]\n\n##### **Suricata**\n\nThe follow up post from a previous post I have shared in this newsletter, in Hands-on walkthrough of the Amazon Web Services Network Firewall flexible rules engine – Part 2 Shiva Vaidyanathan, Brian Lazear, and Lakshmikanth Pandre show you how you can fetch the latest Suricata rules from Proofpoint’s Emerging Threats OPEN ruleset within to help establish a baseline for your rule groups. [hands on]\n\n\n\n##### **Open Source Deep Learning**\n\nFederico Garza Ramírez shares an alternative to the Amazon Web Services Deep Learning AMIs, describing how to set up GPU infrastructure automatically using conda, Docker, make and terraform in his post, ++[Open Source Alternative to the Amazon Web Services Deep Learning AMI](https://aws-oss.beachgeek.co.uk/13p)++. I have not tried it yet, but it is on my todo list. [hands on]\n\n##### **HPC**\n\nWe had a couple of posts for those interesting in open source tools in the HPC space.\n\nFirst up we had a post showing you how to integrate Slurm with Amazon Web Services ParallelCluster. ++[Slurm](https://aws-oss.beachgeek.co.uk/145)++ is an open-source cluster resource management and job scheduling system that strives to be simple, scalable, portable, fault-tolerant, and interconnect agnostic. Josiah Bjorgaard shows you the way in his post, ++[Using the Slurm REST API to integrate with distributed architectures on Amazon](https://aws-oss.beachgeek.co.uk/146)++ [hands on]\n\n\n\nNext we had Austin Cherian and Angel Pizarro with ++[Deep dive into the Amazon Web Services ParallelCluster 3 configuration file](https://aws-oss.beachgeek.co.uk/147)++ perfect if you want to know more about the format changes between ParallelCluster 2 and 3 as well as going deeper with the new features available Amazon Web Services ParallelCluster 3.\n\n##### **Linux**\n\nIn the post ++[Stream applications at a lower cost with Amazon AppStream 2.0 Elastic fleets and Linux compatibility](https://aws-oss.beachgeek.co.uk/14j)++ Blayze Stefaniak shows you how you can use the recently announced Linux support in [Amazon AppStream](https://aws.amazon.com/cn/appstream2/?trk=cndc-detail) to stream Linux applications. Using another new capability, Elastic Fleets, Amazon Web Services manages the capacity users stream from, eliminating the need for you to create autoscaling policies or manage buffer capacity for your end users.\n\n##### **PHP**\n\nPHP is still a very popular programming language, and it always makes me happy when I see new posts covering how to combine PHP with modern application techniques, such as this post ++[Creating Serverless Websites with Amazon Web Services, Bref, and PHP](https://aws-oss.beachgeek.co.uk/14l)++ from Amazon Community Builder Justin Wheeler.\n\n##### **Quick updates**\n###### **JDBC driver for [Amazon Neptune](https://aws.amazon.com/cn/neptune/?trk=cndc-detail)**\n\nAmazon Web Services released an open source Java (JDBC) driver to connect to [Amazon Neptune](https://aws.amazon.com/cn/neptune/?trk=cndc-detail). This makes it easy for customers to connect to Neptune with tools and libraries that support JDBC, such as popular Business Intelligence (BI) tools.\n\n[Amazon Neptune](https://aws.amazon.com/cn/neptune/?trk=cndc-detail) is a fast, reliable, fully managed graph database service that makes it easy to build and run applications that work with highly connected datasets. Customers have asked us for an easy way to connect Neptune to BI tools in order to visualise their data and better understand the results of their queries. Customers can now connect their graph database to these tools, such as Tableau, to visualise the results of their queries.\n\nSee the projects section above for links to the GitHub repo.\n\n###### **Linux**\n\nAmazon Linux 2 is now available with an updated Linux kernel (5.10) as an Amazon Machine Image (AMI). Kernel 5.10 brings a number of features and performance improvements, including optimisations for Intel Ice Lake processors and Amazon Graviton2 processors powering the latest generation [Amazon EC2 ](https://aws.amazon.com/cn/ec2/?trk=cndc-detail)instances. Live patching for Kernel 5.10 is supported in Amazon Linux 2 for both x86 and ARM architectures.\n\nThe updated kernel 5.10 includes various security features including WireGuard VPN that helps setup a virtual private network with low attack surface and allows encryption with less overhead compared to alternatives. The updated kernel brings a kernel lockdown feature to prevent unauthorised modification of the kernel image and a number of BPF improvements, including the CO-RE (Compile Once - Run Everywhere). Customers will benefit from improved write performance, throughput, and support for the new exFAT system for better compatibility with storage devices. In addition, with the availability of MultiPath TCP (MPTCP), customers with several network interfaces can combine all available network paths to increase throughput and reduce network failures.\n\n###### **.NET 6**\n\nCongratulations to all the development teams and community involved in the .NET 6 GA release. .NET developers here at Amazon Web Services are excited about the performance improvements in JIT compilation, Garbage Collection, JSON processing, and many other areas of the new release. We’re also excited about the new features including the Minimal API Framework, new data types, Priority Queues, and more in this new Long Term Support (LTS) release and C# 10.\n\n.NET 6 has improved performance for ARM64, and over the last 12 months we have expanded the number of Amazon Web Services Graviton2 Processor options, providing customers with more choices to target ARM64 with their .NET 6 applications. Targeting ARM64 can add up to 40% better price performance over comparable current generation x86-based instances.\n\nRead more in the announcement, ++[.NET 6 on Amazon](https://aws-oss.beachgeek.co.uk/149)++\n\n###### **MySQL**\n\n[Amazon Aurora](https://aws.amazon.com/cn/rds/aurora/?trk=cndc-detail) MySQL-Compatible Edition now supports MySQL major version 8.0. MySQL 8.0 includes improved performance functionality from enhancements such as instant DDL to speed up the overall process of creating and loading a table and its associated indexes and SKIP LOCKED and NOWAIT options to avoid waiting for other transactions to release row locks. MySQL 8.0 adds developer productivity features such as window functions to more easily solve query problems and common table expressions to enable use of named temporary result sets. It also includes JSON functionality additions, new security capabilities, and more. MySQL 8.0 on Aurora MySQL-Compatible Edition supports popular Aurora features including Global Database, RDS Proxy, Performance Insights, and Parallel Query.\n\nWe also had the blog post, ++[Amazon Aurora MySQL 3 with MySQL 8.0 compatibility is now generally available](https://aws-oss.beachgeek.co.uk/13x)++ from Aditya Samant and Vlad Vlasceanu that dives deeper into this announcement.\n\n###### **[FreeRTOS](https://aws.amazon.com/cn/freertos/?trk=cndc-detail)**\n\nA couple of quick updates covering [FreeRTOS](https://aws.amazon.com/cn/freertos/?trk=cndc-detail).\n\nFirst up we had the news last week that the cellular LTE-M interface library is now generally available in [FreeRTOS](https://aws.amazon.com/cn/freertos/?trk=cndc-detail). With this launch, developers will find it easier to build IoT devices that use the cellular LTE-M protocol to connect to the cloud. The main ++[FreeRTOS download](https://aws-oss.beachgeek.co.uk/13r)++ includes Amazon IoT reference integrations with cellular modules from vendors such as Sierra Wireless, u-blox, and Quectel.\n\nAnd then we had news that [FreeRTOS](https://aws.amazon.com/cn/freertos/?trk=cndc-detail) now contains an example code that demonstrates a method of minimising the time an application spends in privileged mode in [FreeRTOS](https://aws.amazon.com/cn/freertos/?trk=cndc-detail) ports on microcontrollers (MCU) with Memory Protection Unit (MPU) support. [FreeRTOS](https://aws.amazon.com/cn/freertos/?trk=cndc-detail) ports with MPU support enable MCU applications to be more robust and secure by running application tasks in unprivileged mode, where they have access only to their own stacks and pre-configured memory regions. The only application code that runs in privileged mode on these MPU enabled MCUs are Interrupt Service Routines (ISRs). The example code demonstrates an approach to keep ISRs short and defer most of the application work to unprivileged [FreeRTOS](https://aws.amazon.com/cn/freertos/?trk=cndc-detail) tasks, which helps improve security of the application by minimising the time it spends in privileged mode.\n\n###### **Kubernetes**\n\nLast week we saw the general availability of [Amazon Elastic Kubernetes Service](https://aws.amazon.com/cn/eks/?trk=cndc-detail) (EKS) Connector. With EKS Connector, you can now extend the EKS console to view your Kubernetes clusters outside of Amazon Web Services. You can use the EKS console to visualise Kubernetes clusters including your on-premises Kubernetes clusters, self-managed clusters running on Amazon Elastic Compute Cloud (EC2), and clusters from other cloud providers. Once connected, you can see all of your clusters’ statuses, configurations, and workloads in one place on the EKS console.\n\nWe also added support for connected cluster tagging and Kubernetes version display on the EKS console. Registering a cluster is now easier with fewer steps as we’ve automated the Service Linked Role creation. You can also use the Service Quotas console to request connecting more than 10 clusters per region at a time.\n\n###### **Amazon Web Services Data Wrangler**\n\nIn case you missed this last week, Amazon Web Services Data Wrangler is available as a Lambda Managed layer in a number of Amazon Web Services regions. Check out the ++[installation documentation for more details.](https://aws-oss.beachgeek.co.uk/14c)++\n\n###### **RabbitMQ**\n\nYou can now launch RabbitMQ 3.8.23 brokers on [Amazon MQ](https://aws.amazon.com/cn/amazon-mq/?trk=cndc-detail). This patch update to RabbitMQ contains several fixes and enhancements compared to the previously supported version, RabbitMQ 3.8.22.\n\n###### **Amazon Web Services IoT Greengrass**\n\nAmazon Web Services IoT Greengrass is an Internet of Things (IoT) edge runtime and cloud service that helps customers build, deploy, and manage device software. With this release, Amazon Web Services IoT Greengrass version 2.5 adds support for Microsoft Windows devices. Windows gateway devices are commonly used in industrial IoT scenarios to automate manufacturing operations by collecting local sensor and equipment data and triggering local actions using application business logic. For example, consider an automotive assembly line where a steel stamping press creates a complex part that is prone to defects. Quality Control (QC) automation can be built using a video camera stream fed to a gateway device that uses local ML inference to check part dimensions and find cosmetic defects. The gateway could then notify operators if defects are identified.\n\nRead more in the full announcement, ++[Amazon Web Services IoT Greengrass now supports Microsoft Windows devices](https://aws-oss.beachgeek.co.uk/13s)++\n\n##### **Workshop**\n###### **Amazon Web Services SAM**\n\nIf you have been looking to get started with Amazon Web Services SAM, why not check out this workshop, ++[Building Serverless Apps with SAM](https://aws-oss.beachgeek.co.uk/14b)++. Find out how to use this open source project to start building serverless applications.\n\n##### **Video of the week**\n###### **Apache Airflow**\n\nGary Stafford is back again, this time with a session on ++[Building a Data Lake on Amazon Web Services with Apache Airflow](https://aws-oss.beachgeek.co.uk/13u)++. In this video, he shows you how to programmatically build a simple data lake on Amazon Web Services using a combination of services, including [Amazon Managed Workflows for Apache Airflow](https://aws.amazon.com/cn/managed-workflows-for-apache-airflow/?trk=cndc-detail) (Amazon MWAA), Amazon Web Services Glue Data Catalog, Amazon Web Services Glue Crawlers, Amazon Web Services Glue Jobs, Amazon Web Services Glue Studio, [Amazon Athena](https: //aws.amazon.com/cn/athena/?trk=cndc-detail), Amazon Relational Database Service ([Amazon RDS](https://aws.amazon.com/cn/rds/?trk=cndc-detail)), and [Amazon S3](https://aws.amazon.com/cn/s3/?trk=cndc-detail).\n\n<video src=\\"https://dev-media.amazoncloud.cn/6e8c79879fde4bebb767155f374a4e2c_Building%20a%20Data%20Lake%20on%20AWS%20with%20Apache%20Airflow.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n##### **HashiCorp Consul Service Mesh***\n\nBeen a while since I have featured a Containers from the Couch video, but the team are back and this time they are joined by Hashicorp as they walk through deploying Consul as service mesh to [Amazon ECS](https://aws.amazon.com/cn/ecs/?trk=cndc-detail) using the Amazon Web Services CDK.\n\n##### **Events for your diary**\n###### **re:Invent 2021 | Virtual and Las Vegas**\n###### **November 28th to Friday 3rd December**\n\nMake sure you check out the Open Source track at re:Invent this year. As from previous years, there are plenty of great sessions, chalk talks, workshops and builder sessions. There are also open source events across other tracks too. Here is what you can expect:<video src=\\"https://dev-media.amazoncloud.cn/6fce80ccb9674e39b52012f836982e6e_HashiCorp%20Consul%20Service%20Mesh%20on%20Amazon%20ECS.mp4\\" class=\\"manvaVedio\\" controls=\\"controls\\" style=\\"width:160px;height:160px\\"></video>\n\n\n- OPN201 - How Apache Lucene's community built merge-on-refresh\n- OPN202 - Babelfish architecture and design (Chalk Talk)\n- OPN204 - Introduction to GraphQL\n- OPN205 - Construct Hub: An open-source catalog for CDK libraries (Chalk Talk)\n- OPN206 - Getting started as a Bottlerocket contributor (Chalk Talk)\n- OPN207 - Top 10 observability challenges and how open source can help\n- OPN301 - Using Rust to minimize environmental impact\n- OPN302 - Upgrade to OpenSearch (Chalk Talk)\n- OPN303 - Working in the open with OpenSearch (Chalk Talk)\n- OPN304 - Async Rust: Hurry up and .await! (Workshop)\n- OPN305 - Securing your OpenSearch data (Builder Session)\n- OPN307 - OpenSearch: Building the future of search together\n- OPN308 - ML with Metaflow and Kubernetes: Prototype to production on [Amazon EKS](https://aws.amazon.com/cn/eks/?trk=cndc-detail)\n- OPN309 - Amazon Web Services SaaS Boost vNext: Enabling new patterns and extensibility\n- OPN311 - Build your Amazon Web Services Cloud-connected embedded Linux OS faster (Chalk Talk)\n- OPN312 - Building a multi-architecture CI/CD pipeline for Kubernetes (Chalk Talk)\n- OPN313 - When life hands you data, grab OpenSearch (Workshop)\n- OPN314 - Dive deep into cross-SDK features on Amazon Web Services (Workshop)\n- OPN315 - Build a PostgreSQL database cluster with Babelfish (Builder Session)\n- OPN316 - Prometheus and Grafana: Integrated metrics, logs, and traces (Builder Session)\n\nOther sessions of note include:\n\n- AIM409 - Accelerate deep learning with cloud custom environments\n- AIM12 - Deep learning applications with TensorFlow (Chalk Talk)\n- ANT204 - Dive into [Amazon OpenSearch Service](https://aws.amazon.com/cn/opensearch-service/?trk=cndc-detail) (Workshop)\n- ANT401 - Deep dive: Accelerating Apache Spark with [Amazon EMR](https://aws.amazon.com/cn/emr/?trk=cndc-detail)\n- ARC311 - Accelerate building media analysis workflows on Amazon Web Services\n- CON204 - Observability & beyond with container-based services on Amazon Web Services (Workshop)\n- CON210 - Kubernetes scalability and dynamic scheduling\n- CON305 - Automatic node provisioning with Karpenter\n- CON320 - Keeping your host operating system secure with Bottlerocket (Chalk Talk)\n- COP206 - Observability the open-source way\n- COP316 - Open-source observability (Chalk Talk)\n- COP402 - Optimizing Amazon Web Services workflows with the CDK for Terraform\n- DPR203 - The Amazon Web Services DeepRacer open-source robotics showcase\n- IOT302 - Build intelligent IoT devices faster with Amazon Web Services IoT Greengrass (Chalk Talk)\n- HJS304 - Code Green! The sustainability data hackathon and workshop\n- NET301 - Open-source security appliances with Amazon Web Services Gateway Load Balancer (Workshop)\n- QTC306 - Using Julia to program quantum computers (Chalk Talk)\n\n\nIf you are there in person, a few things you should check out:\n\n- Developer Lounge - there will be open source projects being show cased as well as open source builders on hand to speak with you.\n- ++[After Dark](https://aws-oss.beachgeek.co.uk/13n)++ - an open source social that the open source team is organising.\n\nThere is still time to register and attend, so find out more by checking out the ++[event home page](https://aws-oss.beachgeek.co.uk/13m)++.\n\n##### **Stay in touch with open source at Amazon Web Services**\nI hope this summary has been useful. Remember to check out the ++[Open Source homepage](https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&opensource-all.sort-order=asc)++ to keep up to date with all our activity in open source by following us on ++[@Amazon Web ServicesOpen](https://twitter.com/AWSOpen)++\n\n\n\n\n\n\n\n\n\n","render":"<h4><a id=\\"November_22nd_2021__Instalment_91_0\\"></a><strong>November 22nd, 2021 - Instalment #91</strong></h4>\\n<p>Newsletter #91.</p>\n<p>This week I feature eleven new open source projects, covering a diverse array of use cases. From securing your Kubernetes clusters, a couple of nifty Amazon Neptune tools, a Python library that provides state-of-the-art distributed hyper parameter optimising, a sample NFT marketplace and more. This weeks Amazon Web Services community and Amazon Web Services content features topics including Amazon Web Services SAM, Bottlerocket, Babelfish, Apache Airflow, PartiQL, Suricata, Slurm, Apache Kafka, Amazon Web Services Amplify, PHP and more. We have lots of smaller updates in the Quick Updates section, so make sure you do not miss those as well as some fresh new videos to check out.</p>\n<p>Finally, as we approach re:Invent (next week) make sure you check out the extended Events section which includes the sessions to watch out for.</p>\n<h6><a id=\\"reInvent_2021_7\\"></a><strong>re:Invent 2021</strong></h6>\\n<p>If you are going or attending virtually, there is plenty of great open source related sessions this year. Head down to the Events section where I have provided some of the highlights I think that should be on your list of sessions to watch/attend. Also, check the noticeboard to make sure you do not miss the best re:Invent party, After Dark.</p>\n<h4><a id=\\"Celebrating_open_source_contributors_11\\"></a><strong>Celebrating open source contributors</strong></h4>\\n<p>The articles posted in this series are only possible thanks to contributors and project maintainers and so I would like to shout out and thank those folks who really do power open source and enable us all to build on top of what they have created.</p>\n<p>So thank you to the following open source heroes: Vu Dao, Álvaro Hernández, Justin Wheeler, Aditya Samant, Vlad Vlasceanu, Rolando Santamaria Maso, Ramy Nasreldin, Prasanna Tuladhar, Shiva Vaidyanathan, Brian Lazear, Lakshmikanth Pandre, Gary Stafford, Federico Garza Ramírez, Uma Ramadoss, Rene Brandel, Josiah Bjorgaard, Austin Cherian, Angel Pizarro, Joseph Keating, Blayze Stefaniak, David Salinas, Cedric Archambeau, Aaron Klein, and Matthias Seeger.</p>\n<p>Make sure you find and follow these builders and keep up to date with their open source projects and contributions.</p>\n<h5><a id=\\"Community_noticeboard_19\\"></a><strong>Community noticeboard</strong></h5>\\n<h6><a id=\\"After_Dark_Party_20\\"></a><strong>After Dark Party</strong></h6>\\n<p>If you are attending re:Invent next week, then make sure you check out and sign up for the After Dark Party. Whilst sadly I will not be there, it promises to be a great evening of networking with peers. There will be beverages, appetisers, entertainment, swag and more! No presentations, no pitches, just fun!</p>\n<p>Find and more and <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13n\\" target=\\"_blank\\">RSVP, here</a></ins>.</p>\n<h5><a id=\\"Latest_open_source_projects_26\\"></a><strong>Latest open source projects</strong></h5>\\n<h6><a id=\\"synetune_27\\"></a><strong>syne-tune</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14d\\" target=\\"_blank\\">syne-tune</a></ins> this open source Python library provides state-of-the-art distributed hyperparameter optimizers (HPO) where trials can be evaluated with several backend options (local backend to evaluate them locally; SageMaker to evaluate them as separate SageMaker training jobs; another backend with fast startup times is also in the making). To help you get started, David Salinas, Cedric Archambeau, Aaron Klein, and Matthias Seeger have put together this blog post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14e\\" target=\\"_blank\\">Run distributed hyperparameter and neural architecture tuning jobs with Syne Tune</a></ins></p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/fb80c99a7bed4512a436b7a51d4b841e_image.png\\" alt=\\"image.png\\" /></p>\n<h6><a id=\\"amazonneptunegremlindotnetsigv4_33\\"></a><strong>amazon-neptune-gremlin-dotnet-sigv4</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/13q\\" target=\\"_blank\\">amazon-neptune-gremlin-dotnet-sigv4</a></ins><br />\\nlast week we saw released a small, open-source library that enables Amazon Web Services SigV4 signing for connecting to Amazon Neptune on Amazon Web Services with the TinkerPop .Net client. Repository contains sample code and documentation on how to use this.</p>\n<h6><a id=\\"amazonneptunejdbcdriver_38\\"></a><strong>amazon-neptune-jdbc-driver</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/13t\\" target=\\"_blank\\">amazon-neptune-jdbc-driver</a></ins> this open source project provides read-only JDBC connectivity for the Amazon Neptune service using SQL, Gremlin, openCypher and SPARQL queries. Repo contains how to get started with this as well as some sample code.</p>\n<h6><a id=\\"amazonrdsinitcdk_42\\"></a><strong>amazon-rds-init-cdk</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/13v\\" target=\\"_blank\\">amazon-rds-init-cdk</a></ins> I always find code samples and projects a great way to learn how to use Amazon Web Services, and so this repository will show to support Amazon RDS instances initialisation using CDK and CloudFormation Custom Resources. Rolando Santamaria Maso, Ramy Nasreldin, and Prasanna Tuladhar also have put together this blog post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13w\\" target=\\"_blank\\">Use Amazon CDK to initialize Amazon RDS instances</a></ins> to provide further guidance on how to use this code.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/641ebcb99afb4abe8a0bced100ffded3_image.png\\" alt=\\"image.png\\" /></p>\n<h6><a id=\\"K8sSAProbe_48\\"></a><strong>K8s-SAProbe</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/13z\\" target=\\"_blank\\">K8s-SAProbe</a></ins> this project from Jayden Aung should be on your list to checkout if you are working on Kubernetes and are looking for tools to help you secure your clusters. Jayden has helpfully put together this blog post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/140\\" target=\\"_blank\\">SAProbe — A simple tool that discovers exposed Kubernetes Secrets via Service Accounts</a></ins></p>\n<h6><a id=\\"apigwwebsocketpusher_52\\"></a><strong>apigw-websocket-pusher</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14f\\" target=\\"_blank\\">apigw-websocket-pusher</a></ins> this project provides a fast and cost effective way for broadcasting messages to multiple users. Showing you how you can use this is the post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14m\\" target=\\"_blank\\">Amazon Web Services API Gateway Websocket Asynchronous Notifications Pusher</a></ins></p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/6e39aa3ef9b54ef18ee54d7261219f58_image.png\\" alt=\\"image.png\\" /></p>\n<h6><a id=\\"s3datapump_58\\"></a><strong>s3-data-pump</strong></h6>\\n<p>s3-data-pump if you are looking for a way of moving large collections of S3 objects among buckets, then check out this open source project which you can use as the base for your own experimentation.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/2572d91d518740768987c32fa55d9990_image.png\\" alt=\\"image.png\\" /></p>\n<h6><a id=\\"streamingendpointforapachehbase_64\\"></a><strong>streaming-endpoint-for-apache-hbase</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14h\\" target=\\"_blank\\">streaming-endpoint-for-apache-hbase</a></ins> this project helps you create a custom Apache HBase replication endpoint, to stream records into Apache Kafka, Amazon Kinesis or others.</p>\n<h6><a id=\\"simplenftmarketplace_68\\"></a><strong>simple-nft-marketplace</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14i\\" target=\\"_blank\\">simple-nft-marketplace</a></ins> whilst personally I am still on the fence around the useful applications of NFTs, if you are looking to explore this area then you can try out this sample project that helps you build a simple NFT marketplace with Amazon Managed Blockchain.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/ebe02a0de2554082b4ca452f080a0ad7_image.png\\" alt=\\"image.png\\" /></p>\n<h6><a id=\\"azureeventhubconsumerwithdynamodb_74\\"></a><strong>azure-eventhub-consumer-with-dynamodb</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14n\\" target=\\"_blank\\">azure-eventhub-consumer-with-dynamodb</a></ins> if you are looking for some example code on how to build applications that span and integrate between Amazon Web Services and Microsoft Azure, then check this project that shows how you can consume events from Azure Event Hub, storing checkpoint and ownership information in a DynamoDB table, and saving all the event data to a S3 bucket and if needed, logging metrics for consumer latency to CloudWatch Metrics.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/9a6eb1a19bd34b1e919a5acd82738bbe_image.png\\" alt=\\"image.png\\" /></p>\n<h6><a id=\\"rekognitionvideopeopleblurringcdk_80\\"></a><strong>rekognition-video-people-blurring-cdk</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14o\\" target=\\"_blank\\">rekognition-video-people-blurring-cdk</a></ins> this sample project demonstrates how Amazon Web Services Step Functions can be used to orchestrate Amazon Web Services Lambda functions that call Amazon Rekognition for face detections, and use OpenCV to blur these detections per frame in the video. Check out the sample below.</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/90deeb7fa4b74feca7add3fcb281f216_image.png\\" alt=\\"image.png\\" /></p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/6b89085cbf764ba1a01400d13560c0d6_output.gif\\" alt=\\"output.gif\\" /></p>\n<h5><a id=\\"Amazon_Web_Services_open_source_project_revisit_88\\"></a><strong>Amazon Web Services open source project revisit</strong></h5>\\n<p>This section will feature projects that may not be new, but are ones that you should probably check out.</p>\n<h6><a id=\\"awsudo_91\\"></a><strong>awsudo</strong></h6>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14s\\" target=\\"_blank\\">awsudo</a></ins> this open source project from Meltwater is a simple utility for easily executing Amazon Web Services cli commands with an assumed role. Andy Desmarais has put together a blog post, Assuming roles in Amazon Web Services with sudo-like agility, to help you get started.</p>\n<h5><a id=\\"Amazon_Web_Services_and_Community_blog_posts_95\\"></a><strong>Amazon Web Services and Community blog posts</strong></h5>\\n<h6><a id=\\"Amazon_Web_Services_Amplify_96\\"></a><strong>Amazon Web Services Amplify</strong></h6>\\n<p>The big news last week was the announcement that you can now add custom resources when using the Amplify cli that enables developers to add additional resources beyond Amplify’s built-in use cases.</p>\n<p>Rene Brandel shared more details in his posts, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/143\\" target=\\"_blank\\">Extend Amplify backend with custom Amazon Web Services resources using Amazon Web Services CDK or CloudFormation</a></ins> and <ins><a href=\\"https://aws-oss.beachgeek.co.uk/144\\" target=\\"_blank\\">Override Amplify-generated backend resources using CDK</a></ins> [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/540a08fc429a467b843bf4924c1ba0a4_image.png\\" alt=\\"image.png\\" /></p>\n<p>We also had a post from Nikhil Swaminathan and Eric Clemmons of the Amazon Amplify team, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14k\\" target=\\"_blank\\">Amplify UI’s new Authenticator component makes it easy to add customizable login pages to your React, Angular, or Vue app</a></ins> walking you through the recently announced new version of the Authenticator component for JavaScript (JS)-based web apps, giving developers the easiest way to add login experiences to their app with a single line of code. [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/ef7f16984bb34cd58d832683922bd951_authenticator2.gif\\" alt=\\"authenticator2.gif\\" /></p>\n<h5><a id=\\"Bottlerocket_108\\"></a><strong>Bottlerocket</strong></h5>\\n<p>A couple of Bottlerocket posts this week. First up we have Amazon Web Services Community Builder Vu Dao, who has been busy writing <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14q\\" target=\\"_blank\\">Amazon Web Services BottleRocket On EKS NodeGroup</a></ins> with a hands on guide on how to launch a Bottlerocket managed node group on EKS cluster.</p>\n<p>Following that we have a post from Ritesh Patel and Mikhail Shapirov on how to use Bottlerocket OS and Kyverno (an open source Kubernetes native policy engine) on Amazon EKS managed by Nirmata Kubernetes Platform to help secure your Kubernetes environments. To find out more, read on in <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14a\\" target=\\"_blank\\">Provisioning and Securing Bottlerocket OS-Based Amazon EKS Clusters Using Nirmata Kubernetes Platform</a></ins> [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/54c17e69dc16493b97c11526b862336d_image.png\\" alt=\\"image.png\\" /></p>\n<h5><a id=\\"Amazon_Web_Services_SAM_116\\"></a><strong>Amazon Web Services SAM</strong></h5>\\n<p>In <ins><a href=\\"https://aws-oss.beachgeek.co.uk/148\\" target=\\"_blank\\">Modernizing deployments with container images in Amazon Web Services Lambda</a></ins>, Joseph Keating demonstrates how to use Amazon Web Services continuous integration and deployment (CI/CD) services, Amazon Web Services SAM and Docker to separate the container build process from the application deployment process of Lambda container images. [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/ce93dcd21eec475c8d0186470ea0e5cb_image.png\\" alt=\\"image.png\\" /></p>\n<h5><a id=\\"Babelfish_122\\"></a><strong>Babelfish</strong></h5>\\n<p><ins><a href=\\"https://aws-oss.beachgeek.co.uk/14r\\" target=\\"_blank\\">Easily Running Babelfish for PostgreSQL on Kubernetes</a></ins> Amazon Web Services Hero Álvaro Hernández shares how using StackGres 1.1.0, now includes Babelfish, making it easy to run Babelfish on Kubernetes. Do not worry if you are not super knowledgable on Kubernetes, Álvaro has you covered. Awesome stuff, and an essential read this week. [hands on]</p>\n<h5><a id=\\"Apache_Kafka_126\\"></a><strong>Apache Kafka</strong></h5>\\n<p>Amazon Web Services Lambda now supports mutual TLS authentication for Amazon MSK and self-managed Kafka as an event source. This means you can provide a client certificate to establish a trust relationship between Lambda and MSK or self-managed Kafka brokers. To find out more, Uma Ramadoss provides a hands on guide to getting this going in <ins><a href=\\"https://aws-oss.beachgeek.co.uk/141\\" target=\\"_blank\\">Introducing mutual TLS authentication for Amazon MSK as an event source</a></ins> [hands on]</p>\n<h5><a id=\\"PartiQL_131\\"></a><strong>PartiQL</strong></h5>\\n<p>In the post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/142\\" target=\\"_blank\\">Build faster with Amazon DynamoDB and PartiQL: SQL-compatible operations</a></ins> Pete Naylor and Akshat Vig show you how you can use PartiQL in DynamoDB to describe your data operations using SQL-compatible statements. PartiQL support in DynamoDB provides a familiar path so you can build faster, and also provides powerful new batched capabilities. [hands on]</p>\n<h5><a id=\\"Suricata_135\\"></a><strong>Suricata</strong></h5>\\n<p>The follow up post from a previous post I have shared in this newsletter, in Hands-on walkthrough of the Amazon Web Services Network Firewall flexible rules engine – Part 2 Shiva Vaidyanathan, Brian Lazear, and Lakshmikanth Pandre show you how you can fetch the latest Suricata rules from Proofpoint’s Emerging Threats OPEN ruleset within to help establish a baseline for your rule groups. [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/9f0d6996a5f64711a0a8b0260a5697e5_image.png\\" alt=\\"image.png\\" /></p>\n<h5><a id=\\"Open_Source_Deep_Learning_141\\"></a><strong>Open Source Deep Learning</strong></h5>\\n<p>Federico Garza Ramírez shares an alternative to the Amazon Web Services Deep Learning AMIs, describing how to set up GPU infrastructure automatically using conda, Docker, make and terraform in his post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13p\\" target=\\"_blank\\">Open Source Alternative to the Amazon Web Services Deep Learning AMI</a></ins>. I have not tried it yet, but it is on my todo list. [hands on]</p>\n<h5><a id=\\"HPC_145\\"></a><strong>HPC</strong></h5>\\n<p>We had a couple of posts for those interesting in open source tools in the HPC space.</p>\n<p>First up we had a post showing you how to integrate Slurm with Amazon Web Services ParallelCluster. <ins><a href=\\"https://aws-oss.beachgeek.co.uk/145\\" target=\\"_blank\\">Slurm</a></ins> is an open-source cluster resource management and job scheduling system that strives to be simple, scalable, portable, fault-tolerant, and interconnect agnostic. Josiah Bjorgaard shows you the way in his post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/146\\" target=\\"_blank\\">Using the Slurm REST API to integrate with distributed architectures on Amazon</a></ins> [hands on]</p>\n<p><img src=\\"https://dev-media.amazoncloud.cn/01d68edbc16d4989845c8c7ee87255fe_image.png\\" alt=\\"image.png\\" /></p>\n<p>Next we had Austin Cherian and Angel Pizarro with <ins><a href=\\"https://aws-oss.beachgeek.co.uk/147\\" target=\\"_blank\\">Deep dive into the Amazon Web Services ParallelCluster 3 configuration file</a></ins> perfect if you want to know more about the format changes between ParallelCluster 2 and 3 as well as going deeper with the new features available Amazon Web Services ParallelCluster 3.</p>\n<h5><a id=\\"Linux_155\\"></a><strong>Linux</strong></h5>\\n<p>In the post <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14j\\" target=\\"_blank\\">Stream applications at a lower cost with Amazon AppStream 2.0 Elastic fleets and Linux compatibility</a></ins> Blayze Stefaniak shows you how you can use the recently announced Linux support in Amazon AppStream to stream Linux applications. Using another new capability, Elastic Fleets, Amazon Web Services manages the capacity users stream from, eliminating the need for you to create autoscaling policies or manage buffer capacity for your end users.</p>\n<h5><a id=\\"PHP_159\\"></a><strong>PHP</strong></h5>\\n<p>PHP is still a very popular programming language, and it always makes me happy when I see new posts covering how to combine PHP with modern application techniques, such as this post <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14l\\" target=\\"_blank\\">Creating Serverless Websites with Amazon Web Services, Bref, and PHP</a></ins> from Amazon Community Builder Justin Wheeler.</p>\n<h5><a id=\\"Quick_updates_163\\"></a><strong>Quick updates</strong></h5>\\n<h6><a id=\\"JDBC_driver_for_Amazon_Neptune_164\\"></a><strong>JDBC driver for Amazon Neptune</strong></h6>\\n<p>Amazon Web Services released an open source Java (JDBC) driver to connect to Amazon Neptune. This makes it easy for customers to connect to Neptune with tools and libraries that support JDBC, such as popular Business Intelligence (BI) tools.</p>\n<p>Amazon Neptune is a fast, reliable, fully managed graph database service that makes it easy to build and run applications that work with highly connected datasets. Customers have asked us for an easy way to connect Neptune to BI tools in order to visualise their data and better understand the results of their queries. Customers can now connect their graph database to these tools, such as Tableau, to visualise the results of their queries.</p>\n<p>See the projects section above for links to the GitHub repo.</p>\n<h6><a id=\\"Linux_172\\"></a><strong>Linux</strong></h6>\\n<p>Amazon Linux 2 is now available with an updated Linux kernel (5.10) as an Amazon Machine Image (AMI). Kernel 5.10 brings a number of features and performance improvements, including optimisations for Intel Ice Lake processors and Amazon Graviton2 processors powering the latest generation Amazon EC2 instances. Live patching for Kernel 5.10 is supported in Amazon Linux 2 for both x86 and ARM architectures.</p>\n<p>The updated kernel 5.10 includes various security features including WireGuard VPN that helps setup a virtual private network with low attack surface and allows encryption with less overhead compared to alternatives. The updated kernel brings a kernel lockdown feature to prevent unauthorised modification of the kernel image and a number of BPF improvements, including the CO-RE (Compile Once - Run Everywhere). Customers will benefit from improved write performance, throughput, and support for the new exFAT system for better compatibility with storage devices. In addition, with the availability of MultiPath TCP (MPTCP), customers with several network interfaces can combine all available network paths to increase throughput and reduce network failures.</p>\n<h6><a id=\\"NET_6_178\\"></a><strong>.NET 6</strong></h6>\\n<p>Congratulations to all the development teams and community involved in the .NET 6 GA release. .NET developers here at Amazon Web Services are excited about the performance improvements in JIT compilation, Garbage Collection, JSON processing, and many other areas of the new release. We’re also excited about the new features including the Minimal API Framework, new data types, Priority Queues, and more in this new Long Term Support (LTS) release and C# 10.</p>\n<p>.NET 6 has improved performance for ARM64, and over the last 12 months we have expanded the number of Amazon Web Services Graviton2 Processor options, providing customers with more choices to target ARM64 with their .NET 6 applications. Targeting ARM64 can add up to 40% better price performance over comparable current generation x86-based instances.</p>\n<p>Read more in the announcement, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/149\\" target=\\"_blank\\">.NET 6 on Amazon</a></ins></p>\n<h6><a id=\\"MySQL_186\\"></a><strong>MySQL</strong></h6>\\n<p>Amazon Aurora MySQL-Compatible Edition now supports MySQL major version 8.0. MySQL 8.0 includes improved performance functionality from enhancements such as instant DDL to speed up the overall process of creating and loading a table and its associated indexes and SKIP LOCKED and NOWAIT options to avoid waiting for other transactions to release row locks. MySQL 8.0 adds developer productivity features such as window functions to more easily solve query problems and common table expressions to enable use of named temporary result sets. It also includes JSON functionality additions, new security capabilities, and more. MySQL 8.0 on Aurora MySQL-Compatible Edition supports popular Aurora features including Global Database, RDS Proxy, Performance Insights, and Parallel Query.</p>\n<p>We also had the blog post, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13x\\" target=\\"_blank\\">Amazon Aurora MySQL 3 with MySQL 8.0 compatibility is now generally available</a></ins> from Aditya Samant and Vlad Vlasceanu that dives deeper into this announcement.</p>\n<h6><a id=\\"FreeRTOS_192\\"></a><strong>FreeRTOS</strong></h6>\\n<p>A couple of quick updates covering FreeRTOS.</p>\n<p>First up we had the news last week that the cellular LTE-M interface library is now generally available in FreeRTOS. With this launch, developers will find it easier to build IoT devices that use the cellular LTE-M protocol to connect to the cloud. The main <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13r\\" target=\\"_blank\\">FreeRTOS download</a></ins> includes Amazon IoT reference integrations with cellular modules from vendors such as Sierra Wireless, u-blox, and Quectel.</p>\n<p>And then we had news that FreeRTOS now contains an example code that demonstrates a method of minimising the time an application spends in privileged mode in FreeRTOS ports on microcontrollers (MCU) with Memory Protection Unit (MPU) support. FreeRTOS ports with MPU support enable MCU applications to be more robust and secure by running application tasks in unprivileged mode, where they have access only to their own stacks and pre-configured memory regions. The only application code that runs in privileged mode on these MPU enabled MCUs are Interrupt Service Routines (ISRs). The example code demonstrates an approach to keep ISRs short and defer most of the application work to unprivileged FreeRTOS tasks, which helps improve security of the application by minimising the time it spends in privileged mode.</p>\n<h6><a id=\\"Kubernetes_200\\"></a><strong>Kubernetes</strong></h6>\\n<p>Last week we saw the general availability of Amazon Elastic Kubernetes Service (EKS) Connector. With EKS Connector, you can now extend the EKS console to view your Kubernetes clusters outside of Amazon Web Services. You can use the EKS console to visualise Kubernetes clusters including your on-premises Kubernetes clusters, self-managed clusters running on Amazon Elastic Compute Cloud (EC2), and clusters from other cloud providers. Once connected, you can see all of your clusters’ statuses, configurations, and workloads in one place on the EKS console.</p>\n<p>We also added support for connected cluster tagging and Kubernetes version display on the EKS console. Registering a cluster is now easier with fewer steps as we’ve automated the Service Linked Role creation. You can also use the Service Quotas console to request connecting more than 10 clusters per region at a time.</p>\n<h6><a id=\\"Amazon_Web_Services_Data_Wrangler_206\\"></a><strong>Amazon Web Services Data Wrangler</strong></h6>\\n<p>In case you missed this last week, Amazon Web Services Data Wrangler is available as a Lambda Managed layer in a number of Amazon Web Services regions. Check out the <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14c\\" target=\\"_blank\\">installation documentation for more details.</a></ins></p>\n<h6><a id=\\"RabbitMQ_210\\"></a><strong>RabbitMQ</strong></h6>\\n<p>You can now launch RabbitMQ 3.8.23 brokers on Amazon MQ. This patch update to RabbitMQ contains several fixes and enhancements compared to the previously supported version, RabbitMQ 3.8.22.</p>\n<h6><a id=\\"Amazon_Web_Services_IoT_Greengrass_214\\"></a><strong>Amazon Web Services IoT Greengrass</strong></h6>\\n<p>Amazon Web Services IoT Greengrass is an Internet of Things (IoT) edge runtime and cloud service that helps customers build, deploy, and manage device software. With this release, Amazon Web Services IoT Greengrass version 2.5 adds support for Microsoft Windows devices. Windows gateway devices are commonly used in industrial IoT scenarios to automate manufacturing operations by collecting local sensor and equipment data and triggering local actions using application business logic. For example, consider an automotive assembly line where a steel stamping press creates a complex part that is prone to defects. Quality Control (QC) automation can be built using a video camera stream fed to a gateway device that uses local ML inference to check part dimensions and find cosmetic defects. The gateway could then notify operators if defects are identified.</p>\n<p>Read more in the full announcement, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13s\\" target=\\"_blank\\">Amazon Web Services IoT Greengrass now supports Microsoft Windows devices</a></ins></p>\n<h5><a id=\\"Workshop_220\\"></a><strong>Workshop</strong></h5>\\n<h6><a id=\\"Amazon_Web_Services_SAM_221\\"></a><strong>Amazon Web Services SAM</strong></h6>\\n<p>If you have been looking to get started with Amazon Web Services SAM, why not check out this workshop, <ins><a href=\\"https://aws-oss.beachgeek.co.uk/14b\\" target=\\"_blank\\">Building Serverless Apps with SAM</a></ins>. Find out how to use this open source project to start building serverless applications.</p>\n<h5><a id=\\"Video_of_the_week_225\\"></a><strong>Video of the week</strong></h5>\\n<h6><a id=\\"Apache_Airflow_226\\"></a><strong>Apache Airflow</strong></h6>\\n<p>Gary Stafford is back again, this time with a session on <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13u\\" target=\\"_blank\\">Building a Data Lake on Amazon Web Services with Apache Airflow</a></ins>. In this video, he shows you how to programmatically build a simple data lake on Amazon Web Services using a combination of services, including Amazon Managed Workflows for Apache Airflow (Amazon MWAA), Amazon Web Services Glue Data Catalog, Amazon Web Services Glue Crawlers, Amazon Web Services Glue Jobs, Amazon Web Services Glue Studio, Amazon Athena, Amazon Relational Database Service (Amazon RDS), and Amazon S3.</p>\n<p><video src=\\"https://dev-media.amazoncloud.cn/6e8c79879fde4bebb767155f374a4e2c_Building%20a%20Data%20Lake%20on%20AWS%20with%20Apache%20Airflow.mp4\\" controls=\\"controls\\"></video></p>\\n<h5><a id=\\"HashiCorp_Consul_Service_Mesh_232\\"></a><strong>HashiCorp Consul Service Mesh</strong>*</h5>\\n<p>Been a while since I have featured a Containers from the Couch video, but the team are back and this time they are joined by Hashicorp as they walk through deploying Consul as service mesh to Amazon ECS using the Amazon Web Services CDK.</p>\n<h5><a id=\\"Events_for_your_diary_236\\"></a><strong>Events for your diary</strong></h5>\\n<h6><a id=\\"reInvent_2021__Virtual_and_Las_Vegas_237\\"></a><strong>re:Invent 2021 | Virtual and Las Vegas</strong></h6>\\n<h6><a id=\\"November_28th_to_Friday_3rd_December_238\\"></a><strong>November 28th to Friday 3rd December</strong></h6>\\n<p>Make sure you check out the Open Source track at re:Invent this year. As from previous years, there are plenty of great sessions, chalk talks, workshops and builder sessions. There are also open source events across other tracks too. Here is what you can expect:<video src=\\"https://dev-media.amazoncloud.cn/6fce80ccb9674e39b52012f836982e6e_HashiCorp%20Consul%20Service%20Mesh%20on%20Amazon%20ECS.mp4\\" controls=\\"controls\\"></video></p>\\n<ul>\\n<li>OPN201 - How Apache Lucene’s community built merge-on-refresh</li>\n<li>OPN202 - Babelfish architecture and design (Chalk Talk)</li>\n<li>OPN204 - Introduction to GraphQL</li>\n<li>OPN205 - Construct Hub: An open-source catalog for CDK libraries (Chalk Talk)</li>\n<li>OPN206 - Getting started as a Bottlerocket contributor (Chalk Talk)</li>\n<li>OPN207 - Top 10 observability challenges and how open source can help</li>\n<li>OPN301 - Using Rust to minimize environmental impact</li>\n<li>OPN302 - Upgrade to OpenSearch (Chalk Talk)</li>\n<li>OPN303 - Working in the open with OpenSearch (Chalk Talk)</li>\n<li>OPN304 - Async Rust: Hurry up and .await! (Workshop)</li>\n<li>OPN305 - Securing your OpenSearch data (Builder Session)</li>\n<li>OPN307 - OpenSearch: Building the future of search together</li>\n<li>OPN308 - ML with Metaflow and Kubernetes: Prototype to production on Amazon EKS</li>\n<li>OPN309 - Amazon Web Services SaaS Boost vNext: Enabling new patterns and extensibility</li>\n<li>OPN311 - Build your Amazon Web Services Cloud-connected embedded Linux OS faster (Chalk Talk)</li>\n<li>OPN312 - Building a multi-architecture CI/CD pipeline for Kubernetes (Chalk Talk)</li>\n<li>OPN313 - When life hands you data, grab OpenSearch (Workshop)</li>\n<li>OPN314 - Dive deep into cross-SDK features on Amazon Web Services (Workshop)</li>\n<li>OPN315 - Build a PostgreSQL database cluster with Babelfish (Builder Session)</li>\n<li>OPN316 - Prometheus and Grafana: Integrated metrics, logs, and traces (Builder Session)</li>\n</ul>\\n<p>Other sessions of note include:</p>\n<ul>\\n<li>AIM409 - Accelerate deep learning with cloud custom environments</li>\n<li>AIM12 - Deep learning applications with TensorFlow (Chalk Talk)</li>\n<li>ANT204 - Dive into Amazon OpenSearch Service (Workshop)</li>\n<li>ANT401 - Deep dive: Accelerating Apache Spark with Amazon EMR</li>\n<li>ARC311 - Accelerate building media analysis workflows on Amazon Web Services</li>\n<li>CON204 - Observability &amp; beyond with container-based services on Amazon Web Services (Workshop)</li>\n<li>CON210 - Kubernetes scalability and dynamic scheduling</li>\n<li>CON305 - Automatic node provisioning with Karpenter</li>\n<li>CON320 - Keeping your host operating system secure with Bottlerocket (Chalk Talk)</li>\n<li>COP206 - Observability the open-source way</li>\n<li>COP316 - Open-source observability (Chalk Talk)</li>\n<li>COP402 - Optimizing Amazon Web Services workflows with the CDK for Terraform</li>\n<li>DPR203 - The Amazon Web Services DeepRacer open-source robotics showcase</li>\n<li>IOT302 - Build intelligent IoT devices faster with Amazon Web Services IoT Greengrass (Chalk Talk)</li>\n<li>HJS304 - Code Green! The sustainability data hackathon and workshop</li>\n<li>NET301 - Open-source security appliances with Amazon Web Services Gateway Load Balancer (Workshop)</li>\n<li>QTC306 - Using Julia to program quantum computers (Chalk Talk)</li>\n</ul>\\n<p>If you are there in person, a few things you should check out:</p>\n<ul>\\n<li>Developer Lounge - there will be open source projects being show cased as well as open source builders on hand to speak with you.</li>\n<li><ins><a href=\\"https://aws-oss.beachgeek.co.uk/13n\\" target=\\"_blank\\">After Dark</a></ins> - an open source social that the open source team is organising.</li>\n</ul>\\n<p>There is still time to register and attend, so find out more by checking out the <ins><a href=\\"https://aws-oss.beachgeek.co.uk/13m\\" target=\\"_blank\\">event home page</a></ins>.</p>\n<h5><a id=\\"Stay_in_touch_with_open_source_at_Amazon_Web_Services_292\\"></a><strong>Stay in touch with open source at Amazon Web Services</strong></h5>\\n<p>I hope this summary has been useful. Remember to check out the <ins><a href=\\"https://aws.amazon.com/opensource/?opensource-all.sort-by=item.additionalFields.startDate&amp;opensource-all.sort-order=asc\\" target=\\"_blank\\">Open Source homepage</a></ins> to keep up to date with all our activity in open source by following us on <ins><a href=\\"https://twitter.com/AWSOpen\\" target=\\"_blank\\">@Amazon Web ServicesOpen</a></ins></p>\n"}