- Aug 2024
-
bitsand.cloud bitsand.cloud
-
Slashing Data Transfer Costs in AWS by 99%
The essence of cutting AWS data transfer costs by 99% is to use Amazon S3 as an intermediary for data transfers between EC2 instances in different Availability Zones (AZs). Instead of direct transfers, which incur significant costs, you upload the data to S3 (free upload), and then download it within the same region (free download). By keeping the data in S3 only temporarily, you minimize storage costs, drastically reducing overall transfer expenses.
Tags
Annotators
URL
-
-
luminousmen.com luminousmen.com
-
The seasoned engineer learns that sometimes the best code is the code you never wrote. They become adept at delegating tasks, capitalizing on the strengths of their colleagues, and asking the dreaded question, "But why?" — a question that often leads to the heart of what needs to be solved, avoiding unnecessary work and focusing on what truly adds value.
Tags
Annotators
URL
-
- Jun 2024
-
www.bankier.pl www.bankier.pl
-
Polacy ciągle się bogacą. Wzrasta liczba dobrze i bardzo dobrze zarabiających
Infopiguła:
Liczba Polaków zarabiających ponad 10 tys. zł / mc wzrosła w 2022 r. o 51% rdr., do 1,5 mln osób. Na koniec 2022 r. było w Polsce 90 tys. milionerów dolarowych, 10% mniej niż rok wcześniej.
Pensje zarabiających ponad 10 tys. wzrosły o 10% do ok. 375 mld zł. Głównym czynnikiem była wysoka inflacja, ale też napływ Ukraińców z dobrymi zarobkami w korporacjach.
Liczba osób z zarobkami 20-50 tys. zł / mies. wzrosła o 38% do 440 tys., tych z zarobkami między 50 a 83 tys. zł wzrosła o 1% do 84 tys., a osób z zarobkami ponad 83 tys. zł (czyli 1 mln rocznie) spadła o 5% do 35 tys. O prawie 2% wzrosła liczba osób z majątkiem ponad 50 mln $.
-
-
spacelift.io spacelift.io
-
Neither of the methods shown above are ideal in environments where you require several clusters or need them to be provisioned in a consistent way by multiple people.
In this case, IaC is favored over using EKS directly or manually deploying on EC2
-
Running a cluster directly on EC2 also gives you the choice of using any available Kubernetes distribution, such as Minikube, K3s, or standard Kubernetes as deployed by Kubeadm.
-
EKS is popular because it’s so simple to configure and maintain. You don’t need to understand the details of how Kubernetes works or how Nodes are joined to your cluster and secured. The EKS service automates cluster management procedures, leaving you free to focus on your workloads. This simplicity can come at a cost, though: you could find EKS becomes in-flexible as you grow, and it might be challenging to migrate from if you switch to a different cloud provider.
Why use EKS
-
The EKS managed Kubernetes engine isn’t included in the free tier. You’ll always be billed $0.10 per hour for each cluster you create, in addition to the EC2 or Fargate costs associated with your Nodes. The basic EKS charge only covers the cost of running your managed control plane. Even if you don’t use EKS, you’ll still need to pay to run Kubernetes on AWS. The free tier gives you access to EC2 for 750 hours per month on a 12-month trial, but this is restricted to the t2.micro and t3.micro instance types. These only offer 1 GiB of RAM so they’re too small to run most Kubernetes distributions.
Cost of EKS
-
Some of the other benefits of Kubernetes on AWS include
Benefits of using Kubernetes on AWS: - scalability - cost efficiency - high availability
Tags
Annotators
URL
-
-
www.pythonmorsels.com www.pythonmorsels.com
-
Note that the Python documentation refers to these as special methods and notes the synonym "magic method" but very rarely uses the term "dunder method". However, "dunder method" is a fairly common Python colloquialism, as noted in my unofficial Python glossary.
special methods = magic methods = dunder methods
Tags
Annotators
URL
-
-
www.pythonmorsels.com www.pythonmorsels.com
-
python -m webbrowser https://pym.dev/p
Opening URL using Python's webbrowser module
-
-
www.kenmuse.com www.kenmuse.com
-
Sample
.devcontainer/devcontainer.json
:json { "name": "Global", "build": { "context": "..", "dockerfile": "Dockerfile" }, "containerEnv": { "PYTHONPATH": "." }, "customizations": { "vscode": { "settings": { "extensions.verifySignature": false }, "extensions": [ "GitHub.copilot", "ms-python.vscode-pylance", "ms-python.python", "eamodio.gitlens" ] } }, "initializeCommand": "/bin/bash -c '[[ -d ${HOME}/.aws ]] || { echo \"Error: ${HOME}/.aws directory not found.\"; exit 1; }; [[ -f ${HOME}/.netrc ]] || { echo \"Error: ${HOME}/.netrc file not found.\"; exit 1; }; [[ -d ${HOME}/.ssh ]] || { echo \"Error: ${HOME}/.ssh directory not found.\"; exit 1; }; echo \"\n> All required mounts found on the host machine.\"'", "onCreateCommand": { "hadolint": "apt-get update && apt-get install wget -y && wget -O /bin/hadolint https://github.com/hadolint/hadolint/releases/download/v2.12.0/hadolint-Linux-x86_64 && chmod u+x /usr/bin/hadolint", "precommit": "pip install pre-commit" }, "updateContentCommand": "/bin/bash -c 'if grep -A 2 \"machine gitlab.com\" ~/.netrc | grep -q \"password\" && GITLAB_TOKEN=$(grep -A 2 \"machine gitlab.com\" ~/.netrc | grep -oP \"(?<=password ).*\" | tr -d \"\\n\") && [ -n \"$GITLAB_TOKEN\" ]; then echo \"\n> Token found in ~/.netrc\"; else read -sp \"\n> Enter your GitLab token: \" GITLAB_TOKEN && echo; fi; echo \"export GITLAB_TOKEN=$GITLAB_TOKEN\" >> ~/.bashrc && . ~/.bashrc && poetry config http-basic.abc __token__ $GITLAB_TOKEN'", "postCreateCommand": ". ~/.bashrc && curl -s --location 'https://gitlab.com/api/v4/projects/12345/repository/files/.pre-commit-config.yaml/raw?ref=main' --header \"PRIVATE-TOKEN: $GITLAB_TOKEN\" -o .pre-commit-config.yaml", "postAttachCommand": "/bin/bash -c '. ~/.bashrc && read -p \"\n> Do you want to update the content of devcontainer.json? (y/n): \" response; if [[ \"$response\" == \"y\" ]]; then curl -s --location \"https://gitlab.com/api/v4/projects/12345/repository/files/devcontainer.json/raw?ref=main\" --header \"PRIVATE-TOKEN: $GITLAB_TOKEN\" -o .devcontainer/devcontainer.json; else echo \"\n> Skipping update of devcontainer.json\"; fi'", "mounts": [ "source=${localEnv:HOME}/.aws/,target=/root/.aws/,type=bind,readonly", "source=${localEnv:HOME}/.netrc,target=/root/.netrc,type=bind,readonly", "source=${localEnv:HOME}/.ssh/,target=/root/.ssh/,type=bind,readonly" ] }
-
Some more of my recent learning with
devcontainer.json
(its Dev Container metadata):- Interactive commands (those waiting for user input like
read
) do not display the input request in (at leastonCreateCommand
andpostCreateCommand
sections), so it is better to keep them inupdateContentCommand
orpostAttachCommand
. - If there are 2
read
commands in a single section, likeupdateContentCommand
, only the 1st one is displayed to the user, and the 2nd one is ignored. - When I put a
read
command within a dictionary (with at lest 2 key/values) ofpostAttachCommand
, the interactive command wasn't being displayed. - We need to use
/bin/bash -c
to be able to useread -s
(the-s
flag) which allows for securely passing the password so that it does not stay in the VS Code console. Also, I had trouble with interactive commands andif
statements without it. - Using
"GITLAB_TOKEN": "${localEnv:GITLAB_TOKEN}"
does not easily work as it is looking forGITLAB_TOKEN
env variable set locally on our host computers, and I believe no one does it. - The dictionary seems to be executing its scripts in parallel; therefore, it is not easily possible to break down long lines which have to execute in a chronological sequence.
- JSON does not allow for human-readable line breaks; therefore, indeed, it seems impossible to improve the long one-liners.
- The files/folders mentioned within
mounts
need to exist locally (otherwise, Docker container build fails). They are mounted before any other section. Technically, we can protect ourselves with the following command to find an extra message in VS Code container logs:
json "initializeCommand": "/bin/bash -c '[[ -d ${HOME}/.aws ]] || { echo \"Error: ${HOME}/.aws directory not found.\"; exit 1; }; [[ -f ${HOME}/.netrc ]] || { echo \"Error: ${HOME}/.netrc file not found.\"; exit 1; }; [[ -d ${HOME}/.ssh ]] || { echo \"Error: ${HOME}/.ssh directory not found.\"; exit 1; }'",
Other option is to get rid of the error completely, but this creates files on the host machine; therefore, it is not an ideal solution:
json "initializeCommand": "mkdir -p ~/.ssh ~/.aws && touch ~/.netrc",
- Interactive commands (those waiting for user input like
-
["bash", "-i", "-c", "read -p 'Type a message: ' -t 10 && echo Attach $REPLY"],
I would also simply put the following:
bash /bin/bash -c 'read -p 'Type a message: ' -t 10 && echo Attach $REPLY'
-
Consequently, it’s one of the only commands that consistently allows interactions with users.
I also found that
updateContentCommand
allows for the user interaction (it displays interactive command in the VS Code console). -
There are six available lifecycle script hooks
Explanation of 6 available
devcontainer.json
(Dev Container in VS Code) hooks.
-
-
www.abc.net.au www.abc.net.au
-
In one study led by researchers at The University of Oxford, participants with insomnia were divided into two groups and given fake or "sham" feedback on their sleep.One group was told they had a "positive" night's sleep, the other a "negative" night's sleep, and were then asked to rate their mood and sleepiness.Those who were given a fake "negative" score, rated themselves as much sleepier, and their mood significantly worse than those who were given a fake "positive" score, and vice versa.
Why sleep tracking may not make any sense
-
-
-
Alerty BIK to więcej niż ochrona przed wyłudzeniem
List of reasons (below) why I may be paying for BIK alerts (36 (if extended before 07/2024) or 42 PLN per year, although I used to pay 24 PLN).
I may generally consider it while taking a housing loan.
-
- May 2024
-
www.cnbc.com www.cnbc.com
-
At Google, an AI team member said the burnout is the result of competitive pressure, shorter timelines and a lack of resources, particularly budget and headcount. Although many top tech companies have said they are redirecting resources to AI, the required headcount, especially on a rushed timeline, doesn’t always materialize. That is certainly the case at Google, the AI staffer said.
-
A common feeling they described is burnout from immense pressure, long hours and mandates that are constantly changing. Many said their employers are looking past surveillance concerns, AI’s effect on the climate and other potential harms, all in the name of speed. Some said they or their colleagues were looking for other jobs or switching out of AI departments, due to an untenable pace.
-
Artificial intelligence engineers at top tech companies told CNBC that the pressure to roll out AI tools at breakneck speed has come to define their jobs.
-
- Apr 2024
-
-
Lesson 3: When executing a lot of requests to S3, make sure to explicitly specify the AWS region.
-
Lesson 2: Adding a random suffix to your bucket names can enhance security.
-
Lesson 1: Anyone who knows the name of any of your S3 buckets can ramp up your AWS bill as they like.
The author was charged over $1300 after two days of using an S3 bucket, because some OS tool stored a default bucket name in the config, which was the same as his bucket name.
Luckily, after everything AWS made an exception and he did not have to pay the bill.
-
-
-
Google said Axion provides “up to 30% better performance than the fastest general-purpose Arm-based instances available in the cloud today” and “up to 50% better performance and up to 60% better energy-efficiency” than other general purpose Arm chips.
-
Google’s new AI chip is a rival to Nvidia, and its Arm-based CPU will compete with Microsoft and Amazon
-
-
www.danriley.org www.danriley.org
-
Socially, we’re told, “Go work out. Go look good.” That’s a multi-player competitive game. Other people can see if I’m doing a good job or not. We’re told, “Go make money. Go buy a big house.” Again, external multiplayer competitive game. Training yourself to be happy is completely internal. There is no external progress, no external validation. You’re competing against yourself—it is a single-player game.
Tags
Annotators
URL
-
-
kbrzozova.medium.com kbrzozova.medium.com
-
Replacing the lock icon with a neutral indicator prevents the misunderstanding that the lock icon is associated with the trustworthiness of a page, and emphasizes that security should be the default state in Chrome. Our research has also shown that many users never understood that clicking the lock icon showed important information and controls. We think the new icon helps make permission controls and additional security information more accessible, while avoiding the misunderstandings that plague the lock icon.
Explanation why Chrome lock icon was replaced with tune icon
-
-
-
To address the issues of CAS, Karpenter uses a different approach. Karpenter directly interacts with the EC2 Fleet API to manage EC2 instances, bypassing the need for autoscaling groups.
Karpenter
-
The problem occurs when you want to move the pod to another node, in cases such as cluster rebalancing, spot interruptions, and other events. This is because the EBS volumes are zonal bound and can only be attached to EC2 instances within the zone they were originally provisioned in.This is a key limitation that CAS is not able to take into an account when provisioning a new node.
Key limitation of CAS
-
Since Karpenter can schedule nodes quicker, it will most often win this race and provide a new node for the pending workload. CAS will still attempt to create a new node, however will be slower and will most likely have to remove the node after some time, due to emptiness. This brings unnecessary costs to your cloud bill
-
It’s worth mentioning that Cluster Autoscaler and Karpenter can co-exist within the same cluster.
-
-
lethain.com lethain.com
-
I recently chatted with a data science leader who described their company reaching this state. They couldn’t show any business impact from the past two years of their product releases, so the finance team identified a surefire way for R&D to make a business impact: laying off much of the R&D team.
:D
Tags
Annotators
URL
-
-
www.wearedevelopers.com www.wearedevelopers.com
-
Who am I speaking to?What do I want?What do they care about?How can I explain it to them in terms they care about?
Framework for message framing
-
-
jvns.ca jvns.ca
-
To recap, I think these are my personal rebase rules I follow:
Recommendations for doing git rebase (see bullet points below annotation)
Tags
Annotators
URL
-
-
www.mensurdurakovic.com www.mensurdurakovic.com
-
Besides communication, there are other soft skills:teamworklearning mindsetorganization/time managementemotional intelligence/empathyapproachabilitypersistence/patienceconfidence
Core soft skills in IT
-
You can think of it as the following cycle:software engineer writes codeusers get new featuresmore users use your productscompany profits from productsSo code is just a tool to get profit.
The core software development process
-
2) You will rarely get greenfield projects
:)
-
-
lucasoshiro.github.io lucasoshiro.github.io
-
However, as we want to do perform the bisection automatically using as criterion ./calc.py 14 0, we run git bisect run ./calc.py 14 0
git bisect run ./calc.py 14 0 ← example of running git bisect automatically. * If the commit is good, then the command should return 0; * If the commit is bad, then the command should return anything between 1 and 127, inclusive, except 125; * If it is not possible to tell if this commit is good or bad, then it need to be ignored, and the command should return 125.
-
Git Bisect! It allows us to find the commit that broke something. Given a “good” commit (a commit that is not broken, created before the introduction of the bug), and a “bad” commit (a commit that certainly is broken), Git will perform a binary search until the broken commit is found.
Git Bisect can be run manually or automatically
-
What are the tools that comes on your mind when someone say “debug”? Let me guess: a memory leak detector (e.g. Valgrind); a profiler (e.g. GNU gprof); a function that stops your program and gives you a REPL (e.g. Python’s breakpoint and Ruby’s byebug); something that we call a “debugger” (like GDB, or something similar embedded on the IDEs); or even our old friend, the print function. So, in this text I’ll try to convince you to add Git to your debug toolbelt.
6 differen debugging tools
-
-
theaidigest.org theaidigest.org
-
The same LM can be a much more or less capable agent depending on the enhancements added. The researchers created and tested four different agents built on top of GPT-4 and Anthropic’s Claude:
While today’s LMs agents don't pose a serious risk, we should be on the lookout for improved autonomous capabilities as LMs get more capable and reliable.
-
The latest GPT-4 model from OpenAI, which is trained on human preferences using a technique called RLHFEstimated final training run compute cost: ~$50mModel version: gpt-4-0613
~$50m = estimated training cost of GPT-4
Tags
Annotators
URL
-
-
www.across.health www.across.health
-
only 15% of European biopharma respondents reported no interest at all in AI in their organization
-
-
austinhenley.com austinhenley.com
-
Additionally, students in the Codex group were more eager and excited to continue learning about programming, and felt much less stressed and discouraged during the training.
Programming with LLM = less stress
-
On code-authoring tasks, students in the Codex group had a significantly higher correctness score (80%) than the Baseline (44%), and overall finished the tasks significantly faster. However, on the code-modifying tasks, both groups performed similarly in terms of correctness, with the Codex group performing slightly better (66%) than the Baseline (58%).
In a study, students who learned to code with AI made more progress during training sessions, had significantly higher correctness scores, and retained more of what they learned compared to students who didn't learn with AI.
Tags
Annotators
URL
-
-
www.theverge.com www.theverge.com
-
OpenAI is offering limited access to a text-to-voice generation platform it developed called Voice Engine, which can create a synthetic voice based on a 15-second clip of someone’s voice.
OpenAI’s voice cloning AI model only needs a 15-second sample to work
-
- Mar 2024
-
wordpress.org wordpress.org
-
Changing the login URL is a feature we do not include in Wordfence. Though it is something that many people swear by and can help a little in certain situations it’s ultimately not very beneficial. These are the reasons why:
Brief explanation why not to change Wordpress login URL
-
-
antonz.org antonz.org
-
By default, curl uses HTTP/1.1 for the http scheme and HTTP/2 for https. You can change this with flags
-
-
informatykzakladowy.pl informatykzakladowy.pl
-
Sekurak – 4373 Niebezpiecznik – 4171 Z3S – 3383
Comparison of the frequency of posting by the most popular polish cybersecurity blogs: 1. Sekurak 2. Niebezpiecznik 3. Z3S
-
- Feb 2024
-
-
docker init will scan your project and ask you to confirm and choose the template that best suits your application. Once you select the template, docker init asks you for some project-specific information, automatically generating the necessary Docker resources for your project.
docker init
-
-
-
The result? Our runtime image just got 6x smaller! Six times! From > 1.1 GB to 170 MB.
See (above this annotation) the most optimized & CI friendly Python Docker build with Poetry (until this issue gets resolved)
-
This final trick is not known to many as it’s rather newer compared to the other features I presented. It leverages Buildkit cache mounts, which basically instruct Buildkit to mount and manage a folder for caching reasons. The interesting thing is that such cache will persist across builds!By plugging this feature with Poetry cache (now you understand why I did want to keep caching?) we basically get a dependency cache that is re-used every time we build our project. The result we obtain is a fast dependency build phase when building the same image multiple times on the same environment.
Combining Buildkit cache and Poetry cache
-
-
docs.aws.amazon.com docs.aws.amazon.com
-
At a minimum, each ADR should define the context of the decision, the decision itself, and the consequences of the decision for the project and its deliverables
ADR sections from the example: * Title * Status * Date * Context * Decision * Consequences * Compliance * Notes
-
-
marvelousmlops.substack.com marvelousmlops.substack.com
-
We’ve (painstakingly) manually reviewed 310 live MLOps positions, advertised across various platforms in Q4 this year
They went through 310 role descriptions and, even though role descriptions may vary significantly, they found 3 core skills that a large percentage of MLOps roles required:
📦 Docker and Kubernetes 🐍 Python 🌥 Cloud
-
- Jan 2024
-
zaufanatrzeciastrona.pl zaufanatrzeciastrona.pl
-
W cenie 165 euro + podatek (prawie tysiąc złotych) otrzymujemy – teraz nie boję się tego napisać – zabawkę. Fakt, najeżoną techniką, ale zabawkę. W dodatku do jakiegokolwiek działania wymaga ona sporej wiedzy i umiejętności programowania. Niestety w głównej mierze „działająca z pudełka” funkcja tego urządzenia sprowadza się do uniwersalnego pilota telewizyjnego.
-
-
christianheilmann.com christianheilmann.com
-
console.table($$('a'),['innerHTML','href'])
Command to get all the links of a website
-
-
-
LocalStack is a cloud service emulator that runs AWS services solely on your laptop without connecting to a remote cloud provider .
https://www.localstack.cloud/
-
-
jarvispowered.com jarvispowered.com
-
The most common reasons I hear for hating on JIRA are: - It's too complicated - I spend more time tracking tickets than doing workTo that I say...You hate your micro-Manager
-
-
chriswarrick.com chriswarrick.com
-
setuptools is the most popular (at 50k packages), Poetry is second at 41k, Hatchling is third at 8.1k. Other tools to cross 500 users include Flit (4.4k), PDM (1.3k), Maturin (1.3k, build backend for Rust-based packages).
Popularity of Python package managers in 2024
-
-
www.freecodecamp.org www.freecodecamp.org
-
Rick was a very talented developer. Rick could solve complex business logic problems and create sophisticated architectures to support his lofty designs. Rick could not solve the problem of how to work effectively on a team.
:)
-
I dove into the source code. Rick was right: no-one could possibly understand what Rick had created. Except for Rick. It was a reflection of the workings of his own mind. Some of it was very clever, a lot of it was copy-pasta, it was all very idiosyncratic, and it was not at all documented.
I used to work in such a project :)
-
- Dec 2023
-
hyscaler.com hyscaler.com
-
“MLX” is more than just a technical solution; it is an innovative and user-friendly framework inspired by popular frameworks like PyTorch, Jax, and ArrayFire. It facilitates the training and deployment of AI models on Apple devices without sacrificing performance or compatibility.
MLX (high overview)
-
- Nov 2023
-
blog.kubeflow.org blog.kubeflow.org
-
Kubeflow 1.8 adds ARM processor support which simplifies adoption for Apple Silicon users and IoT servers.
Tags
Annotators
URL
-
-
-
RUN poetry install --without dev && rm -rf $POETRY_CACHE_DIR
The ideal way of
poetry install
within aDockerfile
to omit a bunch of cache that would eventually take a lot of space (which we could discover with tools like dive)
-
-
aws.amazon.com aws.amazon.com
-
You can now run Amazon EKS clusters on a Kubernetes version for up to 26 months from the time the version is generally available on Amazon EKS.
-
-
docs.docker.com docs.docker.com
-
Rosetta is now Generally Available for all users on macOS 13 or later. It provides faster emulation of Intel-based images on Apple Silicon. To use Rosetta, see Settings. Rosetta is enabled by default on macOS 14.1 and later.
Tested it on my side, and
poetry install
of one Python project took 44 seconds instead of 2 minutes 53 seconds, so it's nearly a 4x speed increase!
Tags
Annotators
URL
-
- Oct 2023
-
wasmlabs.dev wasmlabs.dev
-
PHP would serve WordPress when it's run as a standalone Wasm application.
php.wasm
can essentially run in: 1. Wasm application (runtime) 2. Docker+Wasm container 3. Any app that embeds a Wasm runtime (e.g. Apache HTTPD) 4. Web browser -
WebAssembly brings true portability to the picture. You can build a binary once and run it everywhere.
-
However, on top of the big image size, traditional containers are also bound to the architecture of the platform on which they run.
-
Wasm container images are much smaller than the traditional ones. Even the alpine version of the php container is bigger than the Wasm one.
php
(166MB),php-alpine
(30.1MB),php-wasm
(5.35 MB) -
With WASI SDK we can build a Wasm module out of PHP's codebase, written in C. After that, it takes a very simple Dockerfile based on scratch for us to make an OCI image that can be run with Docker+Wasm.
Building a WASM container that can be run with Docker+Wasm
-
Docker Desktop now includes support for WebAssembly. It is implemented with a containerd shim that can run Wasm applications using a Wasm runtime called WasmEdge. This means that instead of the typical Windows or Linux containers which would run a separate process from a binary in the container image, you can now run a Wasm application in the WasmEdge runtime, mimicking a container. As a result, the container image does not need to contain OS or runtime context for the running application - a single Wasm binary suffices.
Docker Desktop can run Wasm applications (binaries) instead of OS (Linux/Windows)
-
We now have WebAssembly. Its technical features and portability make it possible to distribute the application, without requiring shipping OS-level dependencies and can run with strict security constraints.
Wasm, as a next step in the evolution of server-side software infrastructure
-
If WASM+WASI existed in 2008, we wouldn't have needed to create Docker. That's how important it is. WebAssembly on the server is the future of computing.
Quote from one of the co-founders of Docker
-
There are Wasm runtimes that can run outside of the browser, including traditional operating systems such as Linux, Windows and macOS. Because they cannot rely on a JavaScript engine being available they communicate with the outside world using different interfaces, such as WASI, the WebAssembly System Interface. These runtimes allow Wasm applications to interact with their host system in a similar (but not quite the same) way as POSIX. Projects like WASI SDK and wasi-libc help people compile existing POSIX-compliant applications to WebAssembly.
Explanation on how Wasm runs on servers
-
Browser engines integrate a Wasm virtual machine, usually called a Wasm runtime, which can run the Wasm binary instructions. There are compiler toolchains (like Emscripten) that can compile source code to the Wasm target. This allows for legacy applications to be ported to a browser and directly communicate with the JS code that runs in client-side Web applications.
Explanation on how Wasm runs in browsers
Tags
Annotators
URL
-
-
collabnix.com collabnix.com
-
the new Docker+Wasm integration allows you to run a Wasm application alongside your Linux containers at much faster speed.
```bash time docker run hello-world ... 0.07s user 0.05s system 1% cpu 8.912 total time docker run --runtime=io.containerd.wasmedge.v1 --platform=wasi/wasm32 ajeetraina/hello-wasm-docker
0.05s user 0.03s system 19% cpu 0.393 total ```
-
Docker Desktop and CLI can now manage both Linux containers and Wasm containers side by side.
-
-
neurosciencenews.com neurosciencenews.com
-
The results showed that the group asked to reduce their social media use had an average 15% improvement in immune function, including fewer colds, flu, warts, and verrucae, a 50% improvement in sleep quality, and 30% fewer depressive symptoms.
-
-
www.ncbi.nlm.nih.gov www.ncbi.nlm.nih.gov
-
Adolescents who spend more than 3 hours per day on social media may be at heightened risk for mental health problems, particularly internalizing problems.
-
-
300gospodarka.pl 300gospodarka.pl
-
We wrześniu 2023 roku w większości badanych zawodów zanotowano spadki liczby ofert pracy rok do roku Największy widoczny jest w branży IT – pracodawcy opublikowali o 52 proc. mniej ofert rok do roku
-
-
stephango.com stephango.com
-
How to assess durability
Set of great questions to assess durability of the to-be purchased item
-
- Sep 2023
-
media.hubspot.com media.hubspot.com
-
Mandel’s system was simple — but incredibly complex from a logistical standpoint
How to win in Lotto every time:
-
-
-
merge queue prevents semantic merge conflicts by automating the rebase process during merge, and ensuring that the trunk branch stays “green.”
merge queue - new GitHub feature
Tags
Annotators
URL
-
-
giansegato.com giansegato.com
-
When I create I learn. When I consume I just relax
-
We all know the old saying practice makes perfect. The more we use a certain region of our brain, the more our brain "prioritizes" and "hones" it. That is what leads to myelin: activity induces myelination, which leads to increased strength of connectivity and efficiency along those very neurons. It’s a self-reinforcing process.
-
The fact of the matter is that digital products make it uniquely easy to trick yourself into thinking that you’re learning when you are actually being entertained.
-
learning must be effortful in order for it to happen
Tags
Annotators
URL
-
- Aug 2023
-
www.thediff.co www.thediff.co
-
engineering blogs focus on problems where the solution is a necessary but not sufficient part of what they do. And, ideally, they focus on problems that are complementary to scale that only the publisher of that post has.
Core reason why companies have their engineering blogs
-
- Jul 2023
-
danielms.site danielms.site
-
cat requirements.txt | grep -E '^[^# ]' | cut -d= -f1 | xargs -n 1 poetry add
Use
poetry init
to create a samplepyproject.toml
, and then trigger this line to exportrequirements.txt
into apyproject.toml
-
-
blog.robertelder.org blog.robertelder.org
-
What happened here is that the file 'somefile.txt' is encoded in UTF-16, but your terminal is (probably) by default set to use UTF-8. Printing the characters from the UTF-16 encoded text to the UTF-8 encoded terminal doesn't show an apparent problem since the UTF-16 null characters don't get represented on the terminal, but every other odd byte is just a regular ASCII character that looks identical to its UTF-8 encoding.
The reason why
grep Hello sometext.txt
may result nothing when the file containsHello World!
.In such a case, use
xxd sometext.txt
to check the file in hex, and then either: - use grep:grep -aP "H\x00e\x00l\x00l\x00o\x00" * sometext.txt
- or convert the file to into UTF-8:iconv -f UTF-16 -t UTF-8 sometext.txt > sometext-utf-8.txt
Tags
Annotators
URL
-
-
event-driven.io event-driven.io
-
Writing to the database may fail (e.g. it will not respond). When that happens, the process handling outbox pattern will try to resend the event after some time and try to do it until the message is correctly marked as sent in the database.
Outbox pattern should be especially implemented when using operations such as PostgreSQL LISTEN/NOTIFY
-
-
www.entrepreneur.com www.entrepreneur.com
-
staff are more open to returning to the office if it is out of choice, rather than forced
-
Unispace finds that nearly half (42%) of companies that mandated office returns witnessed a higher level of employee attrition than they had anticipated. And almost a third (29%) of companies enforcing office returns are struggling with recruitment. Imagine that — nearly half!
-
-
til.simonwillison.net til.simonwillison.net
-
python -m calendar
So surprised that you can output a calendar view using Python
-
python -m site, which outputs useful information about your installation
python -m site
<--- see useful information about your Python installation
Tags
Annotators
URL
-
-
saurabhs.org saurabhs.org
-
sudo softwareupdate -ia installs all available updates.
Quite handy macOS command
-
-
blog.usmanity.com blog.usmanity.com
-
The results from both Midjourney and Stable Diffusion seem to be the most convincing and realistic if I was to judge from a human point of view and if I didn't know they were AI generated, I would believe their results.
Midjourney & Stable Diffusion > Dall-E and Adobe Firefly
-
-
pythonspeed.com pythonspeed.com
-
For a new project, I’d just immediately start with Ruff; for existing projects, I would strongly recommend trying it as soon as you start getting annoyed about how long linting is taking in CI (or even worse, on your computer).
Recommendation for when to use Ruff over PyLint or Flake8
Tags
Annotators
URL
-
- Jun 2023
-
vadimkravcenko.com vadimkravcenko.com
-
A documentation-first culture does not mean everyone is busy writing documents all day. It means that everyone appreciates the value of documenting and sharing their experiences.
Documentation-first culture
-
I’m a big fan of documentation. I think it’s my favorite boring thing to do after coding. It brings the business so much long-term value that every hour invested into documentation by anyone saves literally x100 productivity hours across the company.
High five :)!
-
-
smallstep.com smallstep.com
-
All of these values, including the precious contents of the private key file, can be seen via ps when these commands are running. ps finds them via /proc/<pid>/cmdline, which is globally readable for any process ID.
ps
can read some secrets passed via CLI, especially when using--arg
withjq
.Instead, use the
--rawfile
parameter as noted below this annotation.
Tags
Annotators
URL
-
-
www.telegraph.co.uk www.telegraph.co.uk
-
Digital nomads must earn at least €2,800 per month to qualify for its new visa, around four times Portugal’s minimum wage. According to Nomad List nearly 16,000 people were remote working in Lisbon last December, where they now find themselves blamed for rocketing rents and house prices.
Digital nomads in Portugal
-
According to a March survey, 36 per cent of digital nomads have an annual income of between $100,000 and $250,000. Another eight per cent earn between $250,000 and one million. Attracted by these bank balances, dozens of countries have now introduced so-called “digital nomad visas” (permitting extended stays to work remotely).
Income of digital nomads
-
-
alexwlchan.net alexwlchan.net
-
This is the script, which I’ve named docker and put before the real Docker CLI in my PATH
Script to automatically start Docker if it's not running when we trigger a
docker
command
Tags
Annotators
URL
-
-
-
There are better parameters to evaluate quality, not quantity, of the time spent staring at your screens
Questions to ask for validating mobile apps quality
Tags
Annotators
URL
-
-
news.ycombinator.com news.ycombinator.com
-
The key to hacking yourself is to increase your awareness of your emotional state. When you become aware that you are angry, the anger is losing the grip it has over you. When you are angry, you are sometimes doing things you would not have done if you were not angry. (Sometimes anger is healthy, it may also be a signal to us that our boundaries have been violated.)
Hacks around anger
Tags
Annotators
URL
-
-
drivendata.co drivendata.co
-
Examples of frontends include: pip, build, poetry, hatch, pdm, flit Examples of backends include: setuptools (>=61), poetry-core, hatchling, pdm-backend, flit-core
Frontend and backend examples of Python's build backends
-
pyproject.toml-based builds are the future, and they promote better practices for reliable package builds and installs. You should prefer to use them!
setup.py
is considered a "legacy" functionality these days -
Did you say setuptools? Yes! You may be familiar with setuptools as the thing that used your setup.py files to build packages. Setuptools now also fully supports pyproject.toml-based builds since version 61.0.0. You can do everything in pyproject.toml and no longer need setup.py or setup.cfg.
setuptools can now utilize
pyproject.toml
Tags
Annotators
URL
-
-
blog.devgenius.io blog.devgenius.io
-
// save to tar filedocker save nodeversion > nodeversion.tar// load from tar filedocker load < nodeversion.tar
Saving and loading Docker images locally
-
-
queue.acm.org queue.acm.org
-
Developers often speak of "getting into the flow" or "being in the zone." Such statements colloquially describe the concept of flow state, a mental state in which a person performing an activity is fully immersed in a feeling of energized focus, full involvement, and enjoyment.
One of my favourite explanations of the flow state
-
- May 2023
-
kobzol.github.io kobzol.github.io
-
With this dataclass, I have an explicit description of what the function returns.
Dataclasses give you a lot more clarity of what the function returns, in comparison to returning tuples or dictionaries
-
-
dalelane.co.uk dalelane.co.uk
-
Today is 9th Feb. The oldest segment – segment 100 – still can’t be deleted by the 7-day topic retention policy, because the most recent message in that segment is only 5 days old. The result is that they can see messages dating back to 28th January on this topic, even though the 28th Jan is now 12 days ago. In a couple of days, all the messages in segment 100 will be old enough to exceed the retention threshold so that segment file will be deleted.
retention.ms
set to 7 days doesn't guarantee that you will only see topic messages from the last 7 days. Think of it as a threshold that the Kafka broker can use to decide when messages are eligible for being automatically deleted.
-
-
stackoverflow.com stackoverflow.com
-
Host machine: docker run -it -p 8888:8888 image:version Inside the Container : jupyter notebook --ip 0.0.0.0 --no-browser --allow-root Host machine access this url : localhost:8888/tree
3 ways of running
jupyter notebook
in a container
-
- Apr 2023
-
www.fileside.app www.fileside.app
-
Armed with all this knowledge, we realise that we can construct an almost unlimited number of different path strings that all refer to the same directory
See below the number of ways to define the same path on Windows
-
UNC stands for Universal Naming Convention and describes paths that start with \\, commonly used to refer to network drives. The first segment after the \\ is the host, which can be either a named server or an IP address
UNC paths on Windows
-
On any Unix-derived system, a path is an admirably simple thing: if it starts with a /, it’s a path. Not so on Windows
Paths on Windows are much more complex
Tags
Annotators
URL
-
-
annehelen.substack.com annehelen.substack.com
-
study that found that friends living within a mile of each other are 25 percent more likely to feel happy
-
-
www.punctuationmatters.com www.punctuationmatters.com
-
Em dash Works better than commas to set apart a unique idea from the main clause of a sentence
-
The hyphen does not indicate a range of numbers, like a date range, which is the job of an en dash
Tags
Annotators
URL
-
-
census.dev census.dev
-
As I see it, there are two hard things about getting into flow: loading the state of the system / problem / abstractions into your head (i.e. filling your L1 and L2 cache with everything you need to know to work on the problem) and building momentum and confidence for yourself.
Hard things for entering the flow
Tags
Annotators
URL
-
-
www.oliverburkeman.com www.oliverburkeman.com
-
To return to information overload: this means treating your "to read" pile like a river (a stream that flows past you, and from which you pluck a few choice items, here and there) instead of a bucket (which demands that you empty it). After all, you presumably don't feel overwhelmed by all the unread books in the British Library – and not because there aren't an overwhelming number of them, but because it never occurred to you that it might be your job to get through them all.
Lesson on how to treat one's to-read list
Tags
Annotators
URL
-
-
jonathanhaidt.substack.com jonathanhaidt.substack.com
-
If you suddenly transform the social lives of girls, putting them onto platforms that prioritize social comparison and performance, platforms where we know that heavy users are three times more likely to be depressed than light users, might that have some impact on the mental health of girls around the world? We think so
-
-
-
Kilka przykładów z wykorzystujących Conventional Commits:
Examples of Conventional Commits (see the block below)
-
Conventional Commits – type
Conventional Commits types: - feat - fix - docs - chore - refactor - tests - perf - styles - ci - build - revert
-
Commity o treści refactor, added XXX czy cr fixes, to smutna i nudna rzeczywistość.
-
-
pythonspeed.com pythonspeed.com
-
If you install a package with pip’s --user option, all its files will be installed in the .local directory of the current user’s home directory.
One of the recommendations for Python multi-stage Docker builds. Thanks to
pip install --user
, the packages won't be spread across 3 different paths.
Tags
Annotators
URL
-
- Mar 2023
-
andrew-quinn.me andrew-quinn.me
-
rg . | fzf: Fuzzy search every line in every file
Shortcut for searching files with
ripgrep
andfzf
-
-
-
Spend your career hanging out with people you like working with, doing work you enjoy, trying new experiences, and having fewer regrets.That’s how you retire one day & make it to your deathbed a happy human.
-
You don’t know what day it is. Monday feels like Saturday night fever.
The #1 sign of a successful career
-
-
snarky.ca snarky.ca
-
Honestly, all the activation scripts do are:
See the 4 steps below to understand what activating an environment in Python really does
Tags
Annotators
URL
-
-
-
Using pex in combination with S3 for storing the pex files, we built a system where the fast path avoids the overhead of building and launching Docker images.Our system works like this: when you commit code to GitHub, the GitHub action either does a full build or a fast build depending on if your dependencies have changed since the previous deploy. We keep track of the set of dependencies specified in setup.py and requirements.txt.For a full build, we build your project dependencies into a deps.pex file and your code into a source.pex file. Both are uploaded to Dagster cloud. For a fast build we only build and upload the source.pex file.In Dagster Cloud, we may reuse an existing container or provision a new container as the code server. We download the deps.pex and source.pex files onto this code server and use them to run your code in an isolated environment.
Fast vs full deployments
Tags
Annotators
URL
-
-
interviewing.io interviewing.io
-
"We could use this type of DB, or this other, or that other, and these are some pros and cons… And based on all these tradeoffs, I’ll use THAT type of DB."
Example of how to recommend a single system
-
The difference between coding and system design is the difference between retrieving and creating.Instead of finding (or “retrieving”) a solution, you are creating a solution. In this way, coding is akin to a science, while system design is more like an art.
-
-
noahpinion.substack.com noahpinion.substack.com
-
there’s the famous 2019 paper by Allcott et al. which found that having people deactivate Facebook for a while made them happier, while also making them socialize more and worry less about politics
-
[There’s also] a big new study from Cambridge University, in which researchers looked at 84,000 people…and found that social media was strongly associated with worse mental health during certain sensitive life periods, including for girls ages 11 to 13…One explanation is that teenagers (and teenage girls in particular) are uniquely sensitive to the judgment of friends, teachers, and the digital crowd.
-
First, they’re a distraction — the rise of smartphones was also the rise of “phubbing”, i.e. when people go on their phones instead of paying attention to the people around them.
phubbing
-
Text is a highly attenuated medium — it’s slow and cumbersome, and an ocean of nuance and tone and emotion is lost. Even video chat is a highly incomplete substitute for physical interaction. A phone doesn’t allow you to experience the nearby physical presence of another living, breathing body — something that we spent untold eons evolving to be accustomed to. And of course that’s even before mentioning activities like sex that are far better when physical contact is involved.
It turns out that text/video chatting is not really a replacement for social interactions, yet, it leads to social isolation
-
Yglesias argues that the progressive politics of the 2010s encouraged progressives to think of everything in catastrophic terms, making them less happy.
-
-
tomaszdudek.substack.com tomaszdudek.substack.com
-
You can freely replace SageMaker services with other components as your project grows and potentially outgrows SageMaker.
-
-
github.com github.com
-
This could be because the size can be misleading, there is on disk size, push/pull payload size, and sum of ungzipped tars. The size of the ungzipped tars is often used to represent the size of the image in Docker but the actual size on disk is dependent on the graph driver. From the registry perspective, the sum of the gzipped layers is most important because it represent what the registry is storing and what needs to be transferred.
Docker image size on a local drive will be different
Tags
Annotators
URL
-
-
-
Ultimately, after researching how we can overcome some inconveniences in Kubeflow, we decided to continue using it. Even though the UI could use some improvements in terms of clarity, we didn’t want to give up the advantages of configured CI/CD and containerization, which allowed us to use different environments. Also, for our projects, it is convenient to develop each ML pipeline in separate Git repositories.
Kubeflow sounds like the most feature rich solution, whose main con is its UI and the setup process
-
So, let’s sum up the pros and cons of each tool:
Summary of pros/cons of Airflow, Kubeflow and Prefect
-
The airflow environment must have all the libraries that are being imported in all DAGs. Without using containerization all Airflow pipelines are launched within the same environment. This leads to limitations in using exotic libraries or conflicting module versions for different projects.
Main con of Airflow
-
Prefect is a comparatively new but promising orchestration tool that appeared in 2018. The tool positions itself as a replacement for Airflow, featuring greater flexibility and simplicity. It is an open-source project; however, there is a paid cloud version to track workflows.
-
Airflow has been one of the most popular orchestrating tools for several years.
(see the graph above)
-
An orchestration tool usually doesn’t do the hard work of translating and processing data itself, but tells other systems and frameworks what to do and monitors the status of the execution.
Responsibility of the orchestration tool
-
To this day, the field of machine learning does not have a single generally accepted approach to solving problems in terms of practical use of models.
Business
¯\_(ツ)_/¯
-
-
stackoverflow.com stackoverflow.com
-
Well, in short, with iterators, the flow of information is one-way only. When you have an iterator, all you can really do call the __next__ method to get the very next value to be yielded. In contrast, the flow of information with generators is bidirectional: you can send information back into the generator via the send method.
- Iterator ← one-way communication (can only
yield
stuff) - Generator ← bidirectional communication (can also accept information via the
send
method)
- Iterator ← one-way communication (can only
-
-
mode80.github.io mode80.github.io
-
So why aren't more people using Nim? I don't know! It's the closest thing to a perfect language that I've used by far.
Nim sounds as the most ideal language when comparing to Python, Rust, Julia, C#, Swift, C
Tags
Annotators
URL
-
-
infosecwriteups.com infosecwriteups.com
-
Time to dive a little deeper to see what information the barcodes actually contain. For this I will break down the previously extracted information into smaller pieces.
Information contained within boarding pass barcodes
-
-
news.ycombinator.com news.ycombinator.com
-
"For this campaign, we surveyed 930 Americans to explore their retirement plans. Among them, 16% were retired, 22% were still working, and 62% were retirees who had returned to work."So, 149 of those surveyed were retired. Of those 149, 25 (1 in 6) are considering returning to work. 13 of those want remote positions.
-
-
www.krishnabharadwaj.info www.krishnabharadwaj.info
-
Watching a TED talk gets you high for an hour. Watching an inspiring movie gets you thinking for a day. Reading a book keeps us motivated for about a week.
-
-
jonathanhaidt.substack.com jonathanhaidt.substack.com
-
Instagram was founded in 2010. The iPhone 4 was released then too—the first smartphone with a front-facing camera. In 2012 Facebook bought Instagram, and that’s the year that its user base exploded. By 2015, it was becoming normal for 12-year-old girls to spend hours each day taking selfies
Main cause of global depression
-
-
-
ServingRuntime - Templates for Pods that can serve one or more particular model formats. There are three "built in" runtimes that cover the out-of-the-box model types, custom runtimes can be defined by creating additional ones.
ServingRuntime
-
-
-
cluster with 4096 IP addresses can deploy at most 1024 models assuming each InferenceService has 4 pods on average (two transformer replicas and two predictor replicas).
Kubernetes clusters have a maximum IP address limitation
-
According to Kubernetes best practice, a node shouldn't run more than 100 pods.
-
Each model’s resource overhead is 1CPU and 1 GB memory. Deploying many models using the current approach will quickly use up a cluster's computing resource. With Multi-model serving, these models can be loaded in one InferenceService, then each model's average overhead is 0.1 CPU and 0.1GB memory.
If I am not mistaken, the multi-model approach reduces the size by 90% in this case
-
Multi-model serving is designed to address three types of limitations KServe will run into
Benefits of multi-model serving
-
While you get the benefit of better inference accuracy and data privacy by building models for each use case, it is more challenging to deploy thousands to hundreds of thousands of models on a Kubernetes cluster.
With more separation, comes the problem of distribution
-
-
www.tbray.org www.tbray.org
-
I could be super-happy with any of Fira Code Retina, Hack, JetBrains Mono, or Inconsolata.
Recommended fonts for 14" MacBook
Tags
Annotators
URL
-
-
pythonspeed.com pythonspeed.com
-
depending on how smart the framework is, you might find yourself installing Conda packages over and over again on every run. This is inefficient, even when using a faster installer like Mamba.
-
there’s the bootstrapping problem: depending on the framework you’re using, you might need to install Conda and the framework driver before you can get anything going. A Docker image would come prepackaged with both, in addition to your code and its dependencies. So even if your framework supports Conda directly, you might want to use Docker anyway.
-
Mlflow supports both Conda and Docker-based projects.
-
The only thing that will depend on the host operating system is glibc, pretty much everything else will be packaged by Conda. So a pinned environment.yml or conda-lock.yml file is a reasonable alternative to a Docker image as far as having consistent dependencies.
Conda can be a sufficient alternative to Docker
-
To summarize, for the use case of Python development environments, here’s how you might choose alternatives to Docker:
(see table below)
-
Conda packages everything but the standard C library, from C libraries to the Python interpreter to command-line tools to compilers.
Tags
Annotators
URL
-
-
stackoverflow.com stackoverflow.com
-
So the short answer is to pick rebase or merge based on what you want your history to look like.
Quick summary of rebase vs merge
-
-
www.wisdomination.com www.wisdomination.com
-
In summary, motivation is trying to feel like doing stuff. Discipline is doing it even if you don’t feel like it.
Motivation vs Discipline
-
-
blog.devops.dev blog.devops.dev
-
response times, error rates, and request rates
Sample metrics to monitor
-
You can use authentication mechanisms such as OAuth2, JSON Web Tokens (JWT), or HTTP Basic Authentication to ensure that only authorized users or applications can access your API.
-
In this example, we’ve defined an API endpoint called /predict_image that accepts a file upload using FastAPI's UploadFile type. When a client sends an image file to this endpoint, the file is read and its contents are passed to a preprocessing function that prepares the image for input into the model. Once the image has been preprocessed, the model can make a prediction on it, and the result can be returned to the client as a JSON response.
Example above shows how to upload an image to an API endpoint with FastAPI.
Example below is a bit more complex.
-
For example, if you are using TensorFlow, you might save your model as a .h5 file using the Keras API. If you are using PyTorch, you might save your model as a .pt file using the torch.save() function. By saving your model as a file, you can easily load it into a deployment environment (such as FastAPI) and use it to make predictions on new images
-
- Feb 2023
-
-
Thinking that people are stupid is not thinking. Understanding them is.
-
-
aruva.medium.com aruva.medium.com
-
Regular Shell Commands
Some of my favourite aliases: * 1. (already configured in my ohmyzsh) * 4. * 6. (already configured in my ohmyzsh) * 13. * 17.
-
The set -x command is used to turn on debugging in a shell script and can also be used to test bash aliases. When set -x is used, the command and its arguments are printed to the standard error stream before the command is executed. This can be useful for testing aliases because it lets you see exactly what command is running and with what arguments.
set -x
-
6. A function that checks if a website is up or down
-
5. A function that allows using sudo command without having to type a password every time
-
Kubernetes Aliases
Some of my favourite k8s aliases: * 2. * 3.
-
Mac User Aliases
Some of my favourite Mac aliases: * 1. * 11.
-
A much more elegant approach, however, is to add them to an ~/.aliases like file and then source this file in your respective profile file assource ~/.aliases
More elegant way to list aliases
-
-
paulgraham.com paulgraham.com
-
The way to get new ideas is to notice anomalies: what seems strange, or missing, or broken? You can see anomalies in everyday life (much of standup comedy is based on this), but the best place to look for them is at the frontiers of knowledge.Knowledge grows fractally. From a distance its edges look smooth, but when you learn enough to get close to one, you'll notice it's full of gaps. These gaps will seem obvious; it will seem inexplicable that no one has tried x or wondered about y. In the best case, exploring such gaps yields whole new fractal buds.
Way to get new ideas
-
-
motherduck.com motherduck.com
-
A huge percentage of the data that gets processed is less than 24 hours old. By the time data gets to be a week old, it is probably 20 times less likely to be queried than from the most recent day. After a month, data mostly just sits there.
-
Customer data sizes followed a power-law distribution. The largest customer had double the storage of the next largest customer, the next largest customer had half of that, etc.
-
the vast majority of customers had less than a terabyte of data in total data storage. There were, of course, customers with huge amounts of data, but most organizations, even some fairly large enterprises, had moderate data sizes.
-
Most applications do not need to process massive amounts of data. This has led to a resurgence in data management systems with traditional architectures; SQLite, Postgres, MySQL are all growing strongly, while “NoSQL” and even “NewSQL” systems are stagnating.
SQL still shines over NoSQL
-
The most surprising thing that I learned was that most of the people using “Big Query” don’t really have Big Data. Even the ones who do tend to use workloads that only use a small fraction of their dataset sizes.
-
- Jan 2023
-
collabfund.com collabfund.com
-
I think for some people that’s actually fine. Watching money compound gives them more pleasure than they would get spending it.
-
I think what many people really want from money is the ability to stop thinking about money. To have enough money that they can stop thinking about it and focus on other stuff.
-
To someone who grew up in an old-money affluent family, a Lamborghini might be a symbol of gaudy egotism; to those who grew up with nothing, the car might serve as the ultimate symbol that you’ve made it.
-
How you spend money can reveal an existential struggle of what you find valuable in life, who you want to spend time with, why you chose your career, and the kind of attention you want from other people.
-
-
tedgioia.substack.com tedgioia.substack.com
-
I heard of a peculiar technique used by a company hiring a senior executive. In the final round of interviews, the candidates are taken to lunch, and during the meal something goes wrong—of course, this is all staged as a kind of test. Maybe someone walks up to the table and creates a scene, or perhaps the food delivered to the table is completely wrong. The purpose is to see how the candidate handles the situation. You fail the test if you over-react (for example, causing a scene yourself) or under-react (e.g., just letting things get out of control with no response).
Test of handling unexpected problems
-
If they cheat at small things, they will cheat at big things.
-
Great listeners possess extraordinary skills of awareness and comprehension. They can assess situations with tremendous accuracy, and act in ways that maximize group effectiveness.
-
I’ve met few great listeners in my entire life. But they are some of the most effective individuals I’ve ever encountered.
Try to listen more rather than talk
-
The flaw people hate most in others is usually their own greatest weakness.
-
I’d prefer to take a glimpse at how they spend time and money. Those reveal what a person is really all about.
-
His belief is that people’s character and ability to handle challenges are almost entirely formed during the first two decades of their life.
-
People reveal their true natures when they deal with others who have no power and can never return a favor.
-