Should you’ve received a pair of AirPods Professional 2 and a developer account, you are going to have a brand new firmware replace to get pleasure from.
Apple has launched a brand new beta firmware replace for AirPods Professional 2. Firmware model 7A5290a replaces model 7A5266c and is on the market for each the USB-C and Lightning variations of the wi-fi earbuds so long as you are operating the beta as a developer.
TL;DR: Do away with annoying adverts whereas defending your privateness and confidential knowledge with a lifetime subscription to AdGuard — new customers can get it for simply $11 at TechRepublic Academy.
With a lot enterprise being transacted on-line and a lot of our knowledge being saved within the cloud, sustaining privateness and safety are extra necessary than ever. Plus, these irritating banner and popup adverts could be extra than simply an annoyance. A few of them are literally only a entrance for severely harmful malware. Happily, now you can block adverts and shield your self on-line with a lifetime subscription to AdGuard.
Not solely will AdGuard banish annoying popups, video adverts and banners with superior advert blocking, however additionally, you will get superior knowledge privateness instruments. This system is powered by superior digital and computing know-how to maintain you shielded in our on-line world.
AdGuard offers the last word privateness safety so that you now not must worry the multitude of exercise trackers and analyzers which can be everywhere in the net. Superior safety from malware can also be included. So all your most confidential knowledge might be protected from phishing makes an attempt, fraudulent web sites and different assaults.
You additionally get strong parental management that permits you to create a protected digital atmosphere by limiting your youngsters’s entry to any grownup or inappropriate content material. AdGuard could be put in on as much as three units and is appropriate throughout a number of working techniques, together with Home windows, Android and iOS. So you’ll be able to entry it on desktops and cell units.
It’s straightforward to see why AdGuard has an distinctive consumer score of 4.7 out of 5 stars on Trustpilot. Better of all, since it is a lifetime subscription, you get all these unbelievable options perpetually for only one low fee.
Select your plan and get a lifetime subscription to AdGuard whereas the value has been dropped for brand spanking new customers for a restricted time:
Additionally in search of a VPN? Try AdGuard plans obtainable at TechRepublic Academy:
You can too discover extra nice offers in our collection of Privateness and Safety merchandise.
Costs and availability are topic to alter.
In immediately’s data-driven world, seamless integration and transformation of information throughout numerous sources into actionable insights is paramount. AWS Glue is a serverless knowledge integration service that helps analytics customers to find, put together, transfer, and combine knowledge from a number of sources for analytics, machine studying (ML), and software growth. With AWS Glue, you possibly can uncover and hook up with a whole bunch of numerous knowledge sources and handle your knowledge in a centralized knowledge catalog. It allows you to visually create, run, and monitor extract, remodel, and cargo (ETL) pipelines to load knowledge into your knowledge lakes.
On this weblog put up, we discover the right way to use the SFTP Connector for AWS Glue from the AWS Market to effectively course of knowledge from Safe File Switch Protocol (SFTP) servers into Amazon Easy Storage Service (Amazon S3), additional empowering your knowledge analytics and insights.
The SFTP connector for AWS Glue simplifies the method of connecting AWS Glue jobs to extract knowledge from SFTP storage and to load knowledge into SFTP storage. This connector offers complete entry to SFTP storage, facilitating cloud ETL processes for operational reporting, backup and catastrophe restoration, knowledge governance, and extra.
On this instance, you employ AWS Glue Studio to connect with an SFTP server, then enrich that knowledge and add it to Amazon S3. The SFTP connector is used to handle the connection to the SFTP server. You’ll load the occasion knowledge from the SFTP website, be a part of it to the venue knowledge saved on Amazon S3, apply transformations, and retailer the info in Amazon S3. The occasion and venue recordsdata are from the TICKIT dataset.
The TICKIT dataset tracks gross sales exercise for the fictional TICKIT web site, the place customers purchase and promote tickets on-line for sporting occasions, exhibits, and live shows. On this dataset, analysts can determine ticket motion over time, success charges for sellers, and best-selling occasions, venues, and seasons.
For this instance, you employ AWS Glue Studio to develop a visible ETL pipeline. This pipeline will learn knowledge from an SFTP server, carry out transformations, after which load the reworked knowledge into Amazon S3. The next diagram illustrates this structure.
By the top of this put up, your visible ETL job will resemble the next screenshot.
For this resolution, you want the next:
tickit-use1-.Load the allevents_pipe.txt file and venue_pipe.txt file from the TICKIT dataset to your SFTP server.
An AWS Glue connection is a Knowledge Catalog object that shops connection data, reminiscent of URI strings and placement to credentials which can be saved in a Secrets and techniques Supervisor secret.
To retailer the SFTP server username and password in Secrets and techniques Supervisor, full the next steps:
153.47.122) because the Secret worth, then select Add row.Notice: Secret Worth is the complete S3 path the place the SFTP server key file is saved. For instance:s3://sftp-bucket-johndoe123/id_rsa.
Full the next steps to create your connection to the SFTP server.
An information connection is used to ascertain community connectivity between the VPC and the AWS Glue job. To create the VPC connection, full the next steps.
Now that we accomplished the stipulations, we’re going to setup the AWS Glue Studio job for this resolution. We’ll create a glue studio job, add occasions and venue knowledge from the SFTP server, perform knowledge transformations and cargo reworked knowledge to s3.
Create your AWS Glue Studio job:
Add the occasions knowledge from the SFTP server as your first knowledge set:
| Key | Worth |
| header | false |
| path | /recordsdata (this ought to be the trail to the occasion file in your SFTP server) |
| fileFormat | csv |
| delimiter | | |
Rename the columns of the Occasion dataset:
eventide_venueidcatiddateideventnamestarttime
Add the venue_pipe.txt file from the SFTP website:
| Key | Worth |
| header | false |
| path | /recordsdata (this ought to be the trail to the venue file in your SFTP website) |
| fileFormat | csv |
| delimiter | | |
Rename the columns of the venue dataset:
venueidvenuenamevenuecityvenuestatevenueseats
Be part of the venue and occasion datasets.
Drop the duplicate area:
Load the info into your S3 bucket:
Now you can save and run your AWS Glue visible ETL Job. Run the job after which go to the Runs tab to watch its progress. After the job has accomplished, the Run standing will change to Succeeded. The information might be within the goal S3 bucket.
To keep away from incurring extra fees brought on by sources created as a part of this put up, ensure you delete the gadgets created within the AWS Account for this put up:
On this weblog put up, we demonstrated the right way to use the SFTP connector for AWS Glue to streamline the processing of information from SFTP servers into Amazon S3. This integration performs a pivotal function in enhancing your knowledge analytics capabilities by providing an environment friendly and simple technique to convey collectively disparate knowledge sources. Whether or not your aim is to research SFTP server knowledge for actionable insights, bolster your reporting mechanisms, or enrich your online business intelligence instruments, this connector ensures a extra streamlined and cost-effective method to attaining your knowledge aims.
You need to use SFTP connector for AWS Glue to simplify the method of connecting AWS Glue jobs to extract knowledge from distant SFTP storage or to load knowledge to distant SFTP storage, whereas performing knowledge cleaning and transformations in-memory as a part of your ETL pipelines. On this weblog put up, we discover this resolution in additional element. Alternatively, AWS Switch Household offers fully-managed and AWS native SFTP connectors to reliably copy giant quantity of recordsdata between distant SFTP sources and Amazon S3. You’ve gotten the choice to design an answer utilizing Switch Household’s fully-managed SFTP connector to repeat recordsdata between distant SFTP servers and their Amazon S3 places with none modifications, after which use Glue’s ETL service for cleaning and transformation of the file knowledge.
For additional particulars on the SFTP connector, see the SFTP Connector for Glue documentation.
Sean Bjurstrom is a Technical Account Supervisor in ISV accounts at Amazon Internet Providers, the place he focuses on Analytics applied sciences and attracts on his background in consulting to help prospects on their analytics and cloud journeys. Sean is enthusiastic about serving to companies harness the facility of information to drive innovation and progress. Exterior of labor, he enjoys working and has participated in a number of marathons.
Seun Akinyosoye is a Sr. Technical Account Supervisor supporting public sector buyer at Amazon Internet Providers. Seun has a background in analytics, knowledge engineering which he makes use of to assist prospects obtain their outcomes and targets. Exterior of labor Seun enjoys spending time along with his household, studying, touring and supporting his favourite sports activities groups.
Vinod Jayendra is a Enterprise Assist Lead in ISV accounts at Amazon Internet Providers, the place he helps prospects in fixing their architectural, operational, and value optimization challenges. With a selected deal with Serverless applied sciences, he attracts from his intensive background in software growth to ship top-tier options. Past work, he finds pleasure in high quality household time, embarking on biking adventures, and training youth sports activities crew.
Kamen Sharlandjiev is a Sr. Massive Knowledge and ETL Options Architect, MWAA and AWS Glue ETL professional. He’s on a mission to make life simpler for purchasers who’re dealing with advanced knowledge integration and orchestration challenges. His secret weapon? Totally managed AWS providers that may get the job carried out with minimal effort. Comply with Kamen on LinkedIn to maintain updated with the most recent MWAA and AWS Glue options and information!
Chris Scull is a Options Architect dealing in orchestration instruments and trendy cloud applied sciences. With two years of expertise at AWS, Chris has developed an curiosity in Amazon Managed Workflows for Apache Airflow, which permits for environment friendly knowledge processing and workflow administration. Moreover, he’s enthusiastic about exploring the capabilities of GenAI with Bedrock, a platform for constructing generative AI purposes on AWS.
Shengjie Luo is a Massive knowledge architect of Amazon Cloud Know-how skilled service crew. Chargeable for options consulting, structure and supply of AWS based mostly knowledge warehouse and knowledge lake, and good at server-less computing, knowledge migration, cloud knowledge integration, knowledge warehouse planning, knowledge service structure design and implementation.
Qiushuang Feng is a Options Architect at AWS, answerable for Enterprise prospects’ technical structure design, consulting, and design optimization on AWS Cloud providers. Earlier than becoming a member of AWS, Qiushuang labored in IT corporations reminiscent of IBM and Oracle, and accrued wealthy sensible expertise in growth and analytics.
I’ve a community system with each:
The mobile connection is created with this command:
$ sudo nmcli c add sort gsm con-name telus
ipv4.dns '8.8.8.8 8.8.4.4' autoconnect sure
ifname 'cdc-wdm0' apn 'isp.telus.com'
ipv4.route-metric 1
$ sudo nmcli con up telus
The Modbus ethernet connection is created like this:
$ sudo nmcli con add sort ethernet con-name modbus
ifname enp1s0 connection.autoconnect sure
ipv4.never-default sure
ip4.addresses '10.1.9.7/16, 10.1.9.7/8'
ipv4.routes '10.1.0.0/16 10.1.10.1, 10.0.0.0/8 10.1.10.1'
ipv4.route-metric 800
$ sudo nmcli con up modbus
At this level, the ping check fails:
$ ping -c 1 10.65.3.5
PING 10.65.3.5 (10.65.3.5) 56(84) bytes of information.
^C
--- 10.65.3.5 ping statistics ---
1 packets transmitted, 0 obtained, 100% packet loss, time 0ms
The Hacky Resolution:
I’ve to manually delete one of many routes Community Supervisor creates with ip route:
$ sudo ip route delete 10.0.0.0/8 dev enp1s0 proto kernel scope hyperlink src 10.1.9.7 metric 800
Nice success!
$ ping -c 1 10.65.3.5
PING 10.65.3.5 (10.65.3.5) 56(84) bytes of information.
64 bytes from 10.65.3.5: icmp_seq=1 ttl=126 time=117 ms
--- 10.65.3.5 ping statistics ---
1 packets transmitted, 1 obtained, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 117.203/117.203/117.203/0.000 ms
However I am anxious…
I believe this answer is just momentary, till Community Supervisor places the route again once more…
How one can persist the working configuration so I haven’t got to manually delete the route? It retains popping up once more, as a result of Community Supervisor retains placing it again.
Working routes, after deleting the unhealthy route that makes the ping check fail:
$ sudo ip route delete 10.0.0.0/8 dev enp1s0 proto kernel scope hyperlink src 10.1.9.7 metric 800
$ ip route
default through 10.96.241.146 dev wwan proto static metric 1
10.0.0.0/8 through 10.1.10.1 dev enp1s0 proto static metric 800
10.1.0.0/16 through 10.1.10.1 dev enp1s0 proto static metric 800
10.1.0.0/16 dev enp1s0 proto kernel scope hyperlink src 10.1.9.7 metric 800
10.96.241.144/30 dev wwan proto kernel scope hyperlink src 10.96.241.145 metric 1
Notice the next route isn’t there anymore, but it surely retains getting put again…
10.0.0.0/8 dev enp1s0 proto kernel scope hyperlink src 10.1.9.7 metric 800
Because of this reply, I’ve since added the next script to “/and so forth/NetworkManager/dispatcher.d/99-kill-bad-route.sh”, which can also be sort of hacky…
#!/bin/bash
if [ "$1" == "enp1s0" ] && [ "$2" == "up" ]; then
ip route del 10.0.0.0/8 dev enp1s0 proto kernel scope hyperlink src 10.1.9.7 metric 800
fi
Can the above answer be achieved with a Community Supervisor nmcli command as a substitute?
This is how I automated the answer with Python:
from pathlib import Path
import subprocess
def add_script_to_auto_delete_problem_route(
counter: int,
bad_network: str,
ip_address: str,
interface: str = "enp1s0",
) -> None:
"""
sudo nano /and so forth/NetworkManager/dispatcher.d/9x-delete-problem-route.sh
#!/bin/bash
if [ "$1" == "enp1s0" ] && [ "$2" == "up" ]; then
ip route del 10.0.0.0/8 dev enp1s0 proto kernel scope hyperlink src 10.1.9.7
fi
"""
file_path: Path = Path(
f"/and so forth/NetworkManager/dispatcher.d/9{counter}-delete-problem-route-modbus.sh"
)
script: str = f"""#!/bin/bash
if [ "$1" == "{interface}" ] && [ "$2" == "up" ]; then
ip route del {bad_network} dev {interface} proto kernel scope hyperlink src {ip_address}
fi
"""
print(
"Including script to '%s' to delete drawback route '%s'...",
file_path,
bad_network,
)
if not file_path.mother or father.exists():
file_path.mother or father.mkdir(dad and mom=True, exist_ok=True)
if not file_path.exists():
file_path.contact()
with open(file_path, "w", encoding="utf-8") as file:
file.write(script)
# Make the file executable
command_list: checklist = ["sudo", "chmod", "+x", str(file_path)]
print("Operating command '%s' to make the script executable...", command_list)
subprocess.run(command_list, shell=False)
return None
We have now relied on software program in our telephones and computer systems within the fashionable period. Many purposes, similar to e-commerce, film streaming, sport platforms, and others, have modified how we dwell, as these purposes make issues simpler. To make issues even higher, the enterprise usually offers options that permit suggestions from the info.
The idea of advice techniques is to foretell what the consumer may focused on primarily based on the enter. The system would supply the closest gadgets primarily based on both the similarity between the gadgets (content-based filtering) or the conduct (collaborative filtering).
With many approaches to the advice system structure, we will use the Hugging Face Transformers bundle. When you didn’t know, Hugging Face Transformers is an open-source Python bundle that permits APIs to simply entry all of the pre-trained NLP fashions that help duties similar to textual content processing, era, and lots of others.
This text will use the Hugging Face Transformers bundle to develop a easy suggestion system primarily based on embedding similarity. Let’s get began.
Earlier than we begin the tutorial, we have to set up the required packages. To do this, you should utilize the next code:
pip set up transformers torch pandas scikit-learn
You may choose the appropriate model on your atmosphere by way of their web site for the Torch set up.
As for the dataset instance, we’d use the Anime suggestion dataset instance from Kaggle.
As soon as the atmosphere and the dataset are prepared, we’ll begin the tutorial. First, we have to learn the dataset and put together them.
import pandas as pd
df = pd.read_csv('anime.csv')
df = df.dropna()
df['description'] = df['name'] +' '+ df['genre'] + ' ' +df['type']+' episodes: '+ df['episodes']
Within the code above, we learn the dataset with Pandas and dropped all of the lacking information. Then, we create a function referred to as “description” that incorporates all the data from the out there information, similar to identify, style, sort, and episode quantity. The brand new column would develop into our foundation for the advice system. It might be higher to have extra full data, such because the anime plot and abstract, however let’s be content material with this one for now.
Subsequent, we’d use Hugging Face Transformers to load an embedding mannequin and remodel the textual content right into a numerical vector. Particularly, we’d use sentence embedding to remodel the entire sentence.
The advice system can be primarily based on the embedding from all of the anime “description” we’ll carry out quickly. We might use the cosine similarity technique, which measures the similarity of two vectors. By measuring the similarity between the anime “description” embedding and the consumer’s question enter embedding, we will get exact gadgets to suggest.
The embedding similarity strategy sounds easy, however it may be highly effective in comparison with the traditional suggestion system mannequin, as it may seize the semantic relationship between phrases and supply contextual which means for the advice course of.
We might use the embedding mannequin sentence transformers from the Hugging Face for this tutorial. To remodel the sentence into embedding, we’d use the next code.
from transformers import AutoTokenizer, AutoModel
import torch
import torch.nn.practical as F
def mean_pooling(model_output, attention_mask):
token_embeddings = model_output[0] #First factor of model_output incorporates all token embeddings
input_mask_expanded = attention_mask.unsqueeze(-1).increase(token_embeddings.measurement()).float()
return torch.sum(token_embeddings * input_mask_expanded, 1) / torch.clamp(input_mask_expanded.sum(1), min=1e-9)
tokenizer = AutoTokenizer.from_pretrained('sentence-transformers/all-MiniLM-L6-v2')
mannequin = AutoModel.from_pretrained('sentence-transformers/all-MiniLM-L6-v2')
def get_embeddings(sentences):
encoded_input = tokenizer(sentences, padding=True, truncation=True, return_tensors="pt")
with torch.no_grad():
model_output = mannequin(**encoded_input)
sentence_embeddings = mean_pooling(model_output, encoded_input['attention_mask'])
sentence_embeddings = F.normalize(sentence_embeddings, p=2, dim=1)
return sentence_embeddings
Strive the embedding course of and see the vector consequence with the next code. Nevertheless, I might not present the output because it’s fairly lengthy.
sentences = ['Some great movie', 'Another funny movie']
consequence = get_embeddings(sentences)
print("Sentence embeddings:")
print(consequence)
To make issues simpler, Hugging Face maintains a Python bundle for embedding sentence transformers, which might decrease the entire transformation course of in 3 strains of code. Set up the mandatory bundle utilizing the code beneath.
pip set up -U sentence-transformers
Then, we will remodel the entire anime “description” with the next code.
from sentence_transformers import SentenceTransformer
mannequin = SentenceTransformer('sentence-transformers/all-MiniLM-L6-v2')
anime_embeddings = mannequin.encode(df['description'].tolist())
With the embedding database is prepared, we’d create a operate to take consumer enter and carry out cosine similarity as a suggestion system.
from sklearn.metrics.pairwise import cosine_similarity
def get_recommendations(question, embeddings, df, top_n=5):
query_embedding = mannequin.encode([query])
similarities = cosine_similarity(query_embedding, embeddings)
top_indices = similarities[0].argsort()[-top_n:][::-1]
return df.iloc[top_indices]
Now that every little thing is prepared, we will strive the advice system. Right here is an instance of buying the highest 5 anime suggestions from the consumer enter question.
question = "Humorous anime I can watch with associates"
suggestions = get_recommendations(question, anime_embeddings, df)
print(suggestions[['name', 'genre']])
Output>>
identify
7363 Sentou Yousei Shoujo Tasukete! Mave-chan
8140 Anime TV de Hakken! Tamagotchi
4294 SKET Dance: SD Character Flash Anime
1061 Isshuukan Mates.
2850 Oshiete! Galko-chan
style
7363 Comedy, Parody, Sci-Fi, Shounen, Tremendous Energy
8140 Comedy, Fantasy, Children, Slice of Life
4294 Comedy, Faculty, Shounen
1061 Comedy, Faculty, Shounen, Slice of Life
2850 Comedy, Faculty, Slice of Life
The result’s all the comedy anime, as we would like the humorous anime. Most of them additionally embrace anime, which is appropriate to observe with associates from the style. In fact, the advice can be even higher if we had extra detailed data.
A Advice System is a device for predicting what customers is likely to be focused on primarily based on the enter. Utilizing Hugging Face Transformers, we will construct a suggestion system that makes use of the embedding and cosine similarity strategy. The embedding strategy is highly effective as it may account for the textual content’s semantic relationship and contextual which means.
Cornellius Yudha Wijaya is an information science assistant supervisor and information author. Whereas working full-time at Allianz Indonesia, he likes to share Python and information suggestions by way of social media and writing media. Cornellius writes on quite a lot of AI and machine studying subjects.