RunFaps
Andy Matuschak
Andy Matuschak patreon

Lessons from 2021

🕑 Added 2022-01-26 18:25:35 +0000 UTC

Comments

Maybe keeping an 'open lab notebook' could be useful? The incentive balance that drives the 'File drawer problem' in academia could apply a bit differently here, as I assume that Patreons may be more interested in seeing 'mundane' type results than funding agencies are. As an aside, some scientists I know recently started a publisher (In&Sight) and journal (In&Vertebrates) focused on publishing file drawer science. They have an editorial about it here: https://inandsight.science/journal/papers/619389c04db9cf001cb601bc

> Sometimes you’ll understand some sub-project well enough that you can specify a few weeks of execution work, but there’s no guarantee that the “incoming” rate of well-defined projects will match the “outgoing” rate of projects completed. In practice, I found that I could often specify only a couple days worth of effort in a particular direction—and sometimes that articulation would require half a day or more of preparation! Figuring out what to do is often the most time-intensive step of these projects. In many cases, I could only see what to do next after the last small increment was completed. Wow, this articulates what I often feel when planning my own research work really well - I'm glad I'm not the only one who experiences it. I've also found that it's a good idea to rethink planning out and committing to periods of execution that will take more than a week: even if I can make a plan for a subproject, how it contributes towards the main project almost always gets revised within the month and I'll end up discarding most or all of that work. I don't know if planning research to get the 'minimal viable insights' from every task would be the best strategy (maybe some threads will get thrown away too quickly), but in retrospect that ends up being the takeaway from >80% of my research tasks!

Andy Matuschak

I wonder if anyone ran any experiments on vaccine acceptance vs. exposure to various "explainers".

Andy Matuschak

I really identify with that! I find routine and structure totally essential. As you point out, I think they create the safety I feel I need to trust myself day to day. One recent experiment I've liked is about my "planning." I used to set weekly/monthly/quarterly goals, like lots of people. But I found that these goals made me output-oriented, rather than process-oriented… even when I made the goals notionally process-oriented ("spend at least X hours doing Y"). Just too constraining, not responsive enough to my feelings in the moment. So for a while I abandoned these things and just worked on what I felt like day to day. I liked the expansiveness this imbued, but it created a problem: too much "CEO brain" stuff in the day to day. I'd relitigate my plans and projects on too high-frequency a schedule. It's not really enabling to "ask the big questions" every single morning—I think it's mostly just an impediment. My current approach is to write "vision statements" for major areas of my life at a low frequency (say, quarterly); then each week I write myself a short "menu" of activities to choose from during the week. That way, when I wake up each morning I always have a list of interesting things to pursue that I can trust I've already endorsed. But I always add "soup du jour" to the menu—I can choose to follow a rabbit hole if I like. And they're not *goals*: they're pre-endorsed *choices*.

Ian Stewart

The film production metaphor really stuck out to me -- and compelled me to think that the idea of software engineered for longevity may be directly adjacent to what you're doing, even if it's not directly applicable right now. Obviously, there are reasons why most software is continually updated; I'm not at risk of having my personally identifiable information stolen or my hardware taken over if I simply sit down to watch Casablanca or Back to the Future. But, for instance, in learning about the Common Lisp ecosystem as part of understanding interactive development paradigms, I encountered explicit advice that it's often OK to use CL libraries that may not have been updated for years, because they are quite simply "done." If a problem space and an application implementation are well-defined enough, perhaps the film production model might work for software that's intended to be around for a while? This, of course, begs the bigger-picture, longer-term question: we've got reference texts, so is a potential end result here the ability to generate "reference programs," whatever those may look like? Perhaps I'm asking from a place of frustration, as I'm once again using the James Stewart calculus textbook that's endemic for lower-division math, and I always have to ask why this darned thing really needs an 8th edition when it's hardly changed from my old 4th edition copy. At the same time, having generally-available interactive explainers on complex topics seems like a worthy social good. Max mentioned upthread a molecular biology explorer -- one of my most vivid pandemic memories will be explaining to my friend who's an expert mechanic and fabricator that no, there's absolutely no evidence that the mRNA from the Covid vaccines can somehow rewrite your DNA. Would availability of an interactive explainer have helped vaccine uptake? I don't know, but I can't help but think that giving people agency over understanding the facts, rather than just handing them down from authority, could go a long way.

Really enjoyed your thoughts here! When doing highly creative or speculative or research-y work, I’ve counter-intuitively wanted *more* structure around me so that I can feel safe to play. It’s obviously highly dependent on the type of structure, but that’s why I think I responded so positively to the campus idea, or just a better community in general. I also think it might be part of why people find it hard to leave big tech “campuses” when they’re naturally inclined to want to do this sort of out-there research type work. I think it’s counter-intuitive, because you’d think the best thing for that type of work would be open spaces, no boundaries, free-range. But to have fun while doing this, I think you need to feel a degree of safety to explore without danger. To do this gut-based, or speculation chasing, I sort of want someone else to take care of the rational, CEO brain stuff so I can make more space in my head for this other side to take over.

Andy Matuschak

Yes, I think you're right—that's why I spend two or three working days per month writing an essay here! It's more a question of finding the efficient frontier, I guess. Is 10-15% the right amount of time to spend on non-summative documentation? Is this the right level of fidelity, cost/benefit-wise? At minimum interacting with Philip Guo has persuaded me that I should record more unfiltered videos as a way of getting ideas out quickly and cheaply.

> If I were a traditional academic, I’d probably have published papers on these experiments anyway, since I’d be expected to chalk up a handful of submissions each year. I'm not sure! The "File drawer problem" is a term for a reason. I think it could be useful/interesting, even fun to have maybe videos or essays on avenues of work or thought you explored that didn't end up leading anywhere, what papers you read, what driving questions you had and so forth. Besides for us reading/watching, perhaps the act of forcing yourself to explain them to others could help you see the work you did in different ways. When I recorded a number of thinking.video s forcing myself to verbalize the process of reading papers, I ended up noticing different things, despite the whole process feeling sluggish because so much of the evaluation of the work is being done subconsciously.

Andy Matuschak

This is a great question! I hadn't properly internalized that about Mathematica, but it's a great point. Likewise, VisiCalc and Photoshop were initially for much narrower domains.

As always, deeply appreciated the insights/writing style in here Andy! I want to better understand why there is so little independent work on domain-specific user interfaces (esp in science). One avenue I’m considering: a subproject of a general research agenda (eg my interest in an exploratory medium for molecular biology) - one that’s both a suitable standalone product and points towards a more ambitious system. Eg mathematica started as a physics equations environment before expanding into its current dominant contexts


More Creators