Liberty’s Highlights

Share this post

1: Exploitation vs Exploration, Galactic Mass-Transit System, and Doom

www.libertyrpf.com

1: Exploitation vs Exploration, Galactic Mass-Transit System, and Doom

“exploitation vs exploration”

Liberty
Jul 20, 2020
2
Share this post

1: Exploitation vs Exploration, Galactic Mass-Transit System, and Doom

www.libertyrpf.com

It’s my first time. Be gentle. ¯\_(ツ)_/¯

Investing & Business

-Michael Mauboussin: “exploitation vs exploration”

Interview with Michael Mauboussin on Sean Delaney’s podcast (published July 19), had this interesting quote about the problem of “exploitation vs exploration”:

"Exploitation vs exploration: It's really interesting to ask, from a resource allocation point of view, how much should I allocate to exploitation and how much to exploration. If you look at nature, in environments that don't change much, they're skewed towards exploitation. Why? Because exploration's not that valuable because stuff doesn't change, right? By contrast, in rapidly changing ecosystems, there is a much greater premium put on exploration, because what you're exploiting is going to go away and you need to figure out what's going to be next.


I'd love to think about a way to codify that, to some degree, in a corporate setting. The ways that we can think about measuring rate of change in the environment, and as a consequence, ways to think about, maybe not optimal, but at least directionally correct allocations of exploitation vs exploration." -Michael Mauboussin

If you believe that technological change has accelerated the pace of change in business (and society in general) and that it’s harder to find truly durable businesses with near-impenetrable moats, then it probably makes sense to spend more of your time on exploration and focus on flexibility and adaptability rather than on more static characteristics. NZS Capital has some good papers on this, such as ‘Redefining Margin of Safety’.

-Steven Levy on Facebook

Interview with Steven Levy on Jim Rutt’s show about his new book, “Facebook: The Inside Story”. Like for his book about Google, ‘In the Plex’, Levy had long-term inside access to the company and its executives, including Zuckerberg and Sandberg. I haven’t read the book yet, but thought the podcast interview was interesting and gave a good overview of the strong points and weaknesses of the company.

Here’s an excerpt:

Jim: The problem with micro-targeting is, I can send those racist ads just to racists who aren’t likely to complain. And I think that’s something that the affordances that Facebook provides to all marketers, but particularly political marketers, fundamentally changes the game. Well, it doesn’t fundamentally change the game, but you combine it with the cost advantage. Because you could do micro-targeting with direct mail but it was very expensive. You can do micro-targeting on Facebook, and it’s really cheap and allows you to send different messages to different people and not be held publicly accountable for your advertising.

Steven: Yeah. Yeah. As you say, it doesn’t change the game, it advances it. But it advances it so far that it does change the game. I was saying that if you do the same thing at a bigger speed in a lower cost, it actually becomes a different thing, because you’re able to use it, in a sense, where it affects the situation much more than if you did it at a lower level. It’s like saying the computers we use now in our hands are different devices than those things that we used in the early 1980s.

So I think the micro-targeting becomes a very big issue because Facebook enables that to happen, and as you say, these political marketers can identify people who are susceptible to messages. So Facebook’s model is to deliver advertisements to people who are likely to respond to it. And Facebook argues that you should welcome these advertisements because they are relevant to you. They are going to give you buying opportunities to things that you actually want to buy. […]

But where it’s different, is when Facebook understands enough about you to know where your weakness is, and then sells your contact to people, allows people to contact you to explore your weakness. That’s something different. People aren’t so happy when they hear they’re being manipulated by people, you know? People are able to know their weaknesses and then exploit them. That’s something different, of different character. And we’re having a debate now about whether that’s kosher to do in a political campaign. Some people think that Facebook or anyone else shouldn’t be allowed to do that degree of micro-targeting in a campaign.

There’s a full transcript of the interview here, if you prefer to read.

-Everbridge Now Operating in Every Region in the World

[The company] today announced two national alerting system customers that will be powered by Everbridge Public Warning – one in The Middle East and the other in Africa. Expected to be fully deployed in the second half of 2020, further details of the projects may be available after the completion of all implementation processes. With the addition of these two new countries, Everbridge extends its Public Warning platform to every major region of the world.

This is an interesting company providing a very valuable service to its customers (there’s an overview of what they do in the analyst day presentation).

If you can mitigate or avert even just one crisis that would disrupt your business or country and/or harm your employees or citizens, how much is that worth to you? It’s a bit like insurance: When all is going well, you may wonder why you’re paying, but if things go wrong, you’re glad you spent the tiny amount (compared to most expenses).

-AWS Releases ‘Twitch as a Service’

Interesting new service launched by AWS:

Amazon Interactive Video Service (Amazon IVS) is a managed live streaming solution that is quick and easy to set up, and ideal for creating interactive video experiences. Send your live streams to Amazon IVS using streaming software and the service does everything you need to make low-latency live video available to any viewer around the world, letting you focus on building interactive experiences alongside the live video.

It sounds like a way to embed the kind of video infrastructure you get on Twitch, but on any other site that you control (with your own design, branding, etc).

It’s a building block, so in itself it’s not really much… But it’ll be interesting to see what devs can do with it. As Blake Robbins suggested, streaming stars that already have their own strong brand may decide to build their own sites based on this kind of infrastructure (which may have happened without this, but now the Twitch disruptors may end up on Amazon’s infrastructure):

Twitter avatar for @blakeir
Blake Robbins @blakeir
ayy @Ninja want to just launch ninja.tv?
ninja.tvidentity.tv
1:14 AM ∙ Jul 16, 2020
86Likes1Retweet

-Nvidia: Highlights from July 10 Presentation:

Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
NVDA: "that's why you see NVIDIA as a company moving to becoming more of a data center company for both AI and data science and innovating, not just at processor level or at just the core software level but of the data center as a whole."
5:40 PM ∙ Jul 13, 2020
17Likes2Retweets
Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
NVDA: "If you compare like a ResNet-50 neural network, what it takes to train a network like that, to training some of the modern natural NLP, natural language processing models like Megatron, which was recently published, [that's] 3,000x [more computationally intense]."
5:44 PM ∙ Jul 13, 2020
Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
NVDA: "In the past, the early networks can still run [inference] on the legacy CPU-based data centers.. Today, with the new neural natural language models, they just can't deliver the real-time experience. So we're seeing a big growth in accelerating at the edge."
5:50 PM ∙ Jul 13, 2020
Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
NVDA: "the basic unit of compute is moving from a server to the entire data center. today, when they think about building AI data center, not just building servers. The AI today is moving from a single server, with multiple GPUs in it, to training across the entire data center…"
5:57 PM ∙ Jul 13, 2020
Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
NVDA: "we're the one AI company that's working with every AI company. And by doing that, we learn across all those industries, decide how we can help move the ball forward & then make those technologies freely available to help accelerate the whole AI & data science acceleration"
6:30 PM ∙ Jul 13, 2020
Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
NVDA: "we introduced a new numerical format called TF32... delivers the same accuracy as traditional IEEE FP32. But it runs up to 10x faster. can take a lot of the legacy that were traditionally done with 32-bit and just, without any software modification, run them 10x faster"
2:55 PM ∙ Jul 14, 2020
Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
NVDA: "the work being done in recommender systems right now is fascinating..."
Image
3:05 PM ∙ Jul 14, 2020

-“Basic Bull Thesis for Gaming”

Twitter avatar for @ballmatthew
Matthew Ball (OOO, chopping wood, writing) @ballmatthew
Basic bull thesis for gaming: 1️⃣Americans spend about 2.1B hours per day in de-duplicated media time 2️⃣75% of that time is TV 3️⃣50% of TV time is 50+, 30% is 65+ 4️⃣Gen Y games far more than X, Z far more than Y Thus audience penetration growing + aging into greater media time
2:41 PM ∙ Jul 15, 2020
260Likes40Retweets
Twitter avatar for @ballmatthew
Matthew Ball (OOO, chopping wood, writing) @ballmatthew
For reference
Image
3:49 PM ∙ Jul 15, 2020
15Likes2Retweets

-Podcast Interview with Bill Miller

Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
I enjoyed this podcast interview with Bill Miller. Whether you agree with him or not, he always sounds like his own person and not like a photocopy of a photocopy.
overcast.fmBill Miller on the Classical Value Portfolio (Podcast) — Masters in Business — Overcast
8:13 PM ∙ Jul 10, 2020
48Likes4Retweets

Science & Technology

-GPT-3 and Compute Needed to Train AI Models

The above graph comes from a paper by OpenAI. It shows the compute used to train different models, including the one that has been making waves lately, the third version of their generative pre-training (GPT) language model, aka GPT-3.

As pointed out by Gavin Baker, the graph “ looks like it is growing exponentially, but it is already scaled *logarithmically*”.

OpenAI states in the paper: “Practical large-scale pre-training requires large amounts of computation, which is energy-intensive: training the GPT-3 175B consumed several thousand petaflop/s-days of compute during pre-training, compared to tens of petaflop/s-days for a 1.5B parameter GPT-2 model […] Though models like GPT-3 consume significant resources during training, they can be surprisingly efficient once trained: even with the full GPT-3 175B, generating 100 pages of content from a trained model can cost on the order of 0.4 kW-hr, or only a few cents in energy costs”

Twitter avatar for @tikhonjelvis
Tikhon Jelvis @tikhonjelvis
I'm impressed with the GPT-3 model, but I'm also simply impressed with *language*. The fact that we can get coherent thoughts out of a language model shows us something fundamental about the richness and structure of language itself—I just don't know what exactly :P.
3:18 PM ∙ Jul 20, 2020

-Freeman Dyson’s Galactic Mass-Transit System

Twitter avatar for @nyrath
Winchell Chung⚛🚀 @nyrath
@AlexJayBrady @ToughSf @OneGravitas @NelsonBrn Freeman Dyson pondered absurdly advance civilization manufacturing stellar-mass black holes and putting them into binary orbits. In order to make a galactic mass-transit system. projectrho.com/public_html/ro…
Image
2:21 PM ∙ Jul 14, 2020
17Likes4Retweets

Think of a gravitational slingshot, but with a supercharger:

More details here.

-New Claude Shannon Documentary on Amazon Prime Video

Twitter avatar for @BluegrassCap
Bluegrass Capital @BluegrassCap
Claude Shannon documentary released today
youtube.comThe Bit Player Trailer - Now Available on Amazon Prime - #ClaudeShannon #TheBitPlayerNOW AVAILABLE ON AMAZON PRIME VIDEO: https://www.amazon.com/gp/video/detail/B08D291YQS/ref=atv_dp_share_cu_r Synopsis In a blockbuster paper in 1948, Claude ...
4:29 PM ∙ Jul 17, 2020
149Likes27Retweets

I haven’t had a chance to see it yet, but I really enjoyed the recent biography of Shannon (a world-changing genius that is too little-known by most people — another one that should get more books and documentaries is John von Neumann):

A Mind at Play: How Claude Shannon Invented the Information Age ...

-RISC-V Open-Source Instruction Set

Good interview with David Patterson, mostly about instruction set design and the tradeoffs between various CPU architectures, RISC-V open source arch, etc (audio-only podcast can be found here):


The Arts

-Can it run DOOM?

This is deep on the geeky end of culture, but here’s a 32 socket computer with 32 CPUs that each have 28 cores, for a total of 896 cores. Some genius found a way to play Doom on the computer’s task manager in Windows by using each core by a certain amount, turning each one into a pixel that can be made darker or lighter. It’s kind of mind-boggling. See for yourself (play the video to see it in action):

Here’s what the 32-socket monster looks like:

Twitter avatar for @winocm
sarah @ ganbaranai @winocm
@MalwareMinigun @ares_emu There you go. Octopus.
Image
5:13 AM ∙ Jul 18, 2020
225Likes13Retweets

-I’m More Afraid of Things Staying the Same

These Nick Cave lyrics pop to mind once in a while, especially in times of great confusion and uncertainty. I have to remember that things always change, and stability is a temporary illusion, and that it’s better to accept it and embrace it and to try to make the best of it rather than be dragged along kicking and screaming. If you believe that the world can be better, then change is just an opportunity to keep improving it, little by little (over time it adds up):

Twitter avatar for @LibertyRPF
Liberty @LibertyRPF
"Cause people often talk about being scared of change But for me I'm more afraid of things staying the same Cause the game is never won by standing in any one place for too long" --Nick Cave, lyrics
Image
12:04 AM ∙ Mar 30, 2018
5Likes3Retweets
Share this post

1: Exploitation vs Exploration, Galactic Mass-Transit System, and Doom

www.libertyrpf.com
Next
Comments
TopNewCommunity

No posts

Ready for more?

© 2023 Liberty RPF
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing