Sunday, October 25, 2020

80 authors, 80 science fiction stories shorter than novels

This is an update to 50 authors, 50 science fiction stories shorter than novels. It's mostly an addition of 30 more authors (many from outside the "big SF names") but I also made some other tweaks.

 I've been playing around with re-reading favorite science fiction short stories while also seeing if there's anything that has managed to elude me over the years. I've also tried to catch up with more recent authors given that I don't read as many books as I used to. (The market for science fiction short stories, in general, is in something of a decline but there are still some fabulous recent stories out there.)

A few rules I set for myself:
  • One story per author. Certainly there are many on this list for whom I could effortlessly reel off multiple deserving entries. A side effect of this rule is that it brought a fair bit of organic diversity to the list which would otherwise have been more heavily populated by a handful of favorite authors.
  • Nothing is novel length but you'll find plenty of novelettes and novellas alongside the short stories. That said, I've tried to favor shorter works and stories that stand well on their own.
  • I didn't include authors whose novels I enjoy but just don't have any short stories I'm aware of that grabbed me though I've snuck in recognizing overall achievement where there was at least a reasonable hook. 
  • Everything here can be plausibly categorized as science fiction although some hew closer to traditional sf tropes than others which are at least adjacent to horror, fantasy, and philosophical fiction.
  • Be interesting! Provoke conversation!
I used various lists and recommendations to tickle my memory, ferret out works I might not be familiar with, and point me to highlights in collections. But I've read everything here and don't think I've included anything just because it's "expected" even if I was coaxed into one or two. They're (almost) all stories I like even if I did aim for overall variety of time period, style, and subject matter. In particular, I wanted to bring in some fresher or lesser known voices rather than convincing myself that all older award-winning stories stand up well today. 

Many of these stories can be found online and others in popular "best of" collections. Others are probably harder to come by but I don't think there's anything here that is really hard to find. The Internet Speculative Fiction Database is a good starting point if you're trying to identify collections where a story appears.

Anyway, my list (sorted chronologically) is below. While it's one story per author I do include pointers to other works in the comments. I've been careful to err on the side of avoiding spoilers but if you want to go into the stories completely cold, by all means, just work from the list of titles and authors.

"The Mortal Immortal" Mary Shelley (1833)

You may have heard of Mary Wollstonecraft Shelley. Something about a monster story conceived during a "wet, uncongenial summer" in 1816. Frankenstein; or, The Modern Prometheus, would be published in 1818 and has become a cultural touchstone. Shelley also published many other works in a variety of styles, including this story which concerns the challenges of being an immortal.

"Flatland" Edwin A. Abbott (1884)

This satirical "Romance of Many Dimensions" novella by the English schoolmaster Edwin Abbott Abbott was originally intended to use the fictional two-dimensional world of Flatland to comment on the hierarchy of Victorian culture. However, it became more broadly known when Einstein's General Theory of Relativity introduced the concept of multiple dimensions into popular discourse. 

"A Dream of Armageddon" H. G. Wells (1901)

This story comes from prolific Victorian writer Herbert George Wells. Wells wrote in a variety of genres including social commentary and history. However, he's most remembered for his science fiction novels like War of the Worlds (which was famously made into a radio play as well as films of varying levels of quality). This story used the fictional device of a man recounting dreams of a future time in which he is a political figure who has withdrawn from life to live with a younger woman on the island of Capri, even though this withdrawal is enabling opponents to start a great war with futuristic aircraft. Wells would later build on the concept for his novel The Shape of Things to Come which would itself serve as the loose basis for a film of the same name in 1936.

"With the Night Mail" Rudyard Kipling (1905)

Rudyard Kipling would win the Nobel Prize in Literature a couple years after this story was published. Unlike Wells, Kipling is not remembered for science fiction; rather he's mostly associated with stories and poetry often set in colonial India, where he was born and lived much of his early life. "With the Night Mail" is one of only two science fiction stories that Kipling wrote. Both concern the workings and activities of The Aerial Board of Control, a 21st century fictional organization that manages the dirigible and other air traffic for the whole world and acts as a de facto world government. 

"The Machine Stops" E. M. Forster (1909)

Rounding out this trio of Victorian English authors, Forster's reputation also comes in part from a novel, A Passage to India, that concerns the relationship between East and West as seen through the lens of India in the latter days of the British Raj--as well as other novels that primarily focused on class differences in England. Forster wrote that "'The Machine Stops' is a reaction to one of the earlier heavens of H. G. Wells." [The Eloi of The Time Machine.] In this novella, humanity lives underground and relies on a giant machine to provide its needs. There are technologies similar to video conferencing and the Internet. But the machine begins to fail and no one remembers how to fix it. This story is widely considered to be one of the most prescient short works of early science fiction.

"At the Mountains of Madness" H.P. Lovecraft (1936)

H.P. Lovecraft's primary reputation is as a horror writer. However, his stories that were part of the Cthulhu Mythos (such as this one) borrow premises often associated with science fiction such as alien invasion, other dimensions, and interference with human cultural and physiological evolution. For example, this novella popularized ancient astronaut theories as it details the events of a disastrous expedition to the Antarctic continent and what was found there by a group of explorers led by the narrator, Dr. William Dyer of Miskatonic University. 

"Microcosmic God" Theodore Sturgeon (1941)

Originally published in the magazine Astounding Science Fiction, this story is an early example of the use of the "pocket universe" concept in science fiction. A biochemist develops a synthetic life form which lives (and invents) far more quickly than humans can. This biochemist, Kidder, is their "god" who exerts his power over them and profits from them. Sturgeon is not generally very well known but this particular story regularly and deservedly appears in anthologies and best-of lists.

"The Library of Babel" Jorge Luis Borges (1941)

This short story, originally written in Spanish by Argentine author and librarian Jorge Luis Borges, is  more of a philosophical exploration than a science fiction story in the usual sense. It asks you to imagine a library whose books contain every possible combination of letters and numbers. Every great work is there, the account of your death is there, and every possible scientific discovery that can be written down exists in the library. But any true information would be buried in, and rendered indistinguishable from, all possible forms of false information and complete gibberish. 

"The Weapon Shop" A. E. van Vogt (1942)

This story was developed from a much shorter 1941 story, "The Seesaw." It was, in turn, used as the basis for a portion of the 1951 fix-up novel The Weapon Shops of Isher; another closely related novel published during the same period was The Weapon Makers. These books revolve around the immortal Robert Hedrock who once created the Weapon Shops as a force to counteract the imperial world government long dominant on earth. These two novels bring together van Vogt's style of hard science fiction and transcendent superheroes more than his other books. However, this short story may do an even better job on its own.

"Mimsy were the Borogoves" Lewis Padgett (1943)

Padgett was the pseudonym of spouses Henry Kuttner and C. L. Moore when they were writing together, often to humorous effect. This story title was inspired by a verse from “Jabberwocky,” a poem found in the classic novel Through the Looking-Glass by Lewis Carroll. It imagines mysterious educative toys timeslipped in from the future, which leads to the children discovering them to start thinking in new patterns and communicating in strange ways. "Twonky" and "The Time Locker" are other Padgett stories for which they're often remembered.

"Arena" Frederic Brown (1944)

Brown, who also wrote detective fiction, was noted for stories that were written with, what The Encyclopedia of Science Fiction calls "professional economies of effect." This short story is one of those. It tells of the settling of an interstellar war through single combat between a human and an alien. Either the story name or the plot summary may seem familiar to Star Trek fans; it was a popular episode during the first season of the classic series. Brown experimented with narrative styles. "The Sentry" is a micro-short which may seem more predictable today than when it was written. 

"A Logic Named Joe" Murray Leinster (1946)

This story, originally published under Leinster's real name (William F. Jenkins) contains an early description of a computer (called a "logic") in fiction. In the story, he imagined the Internet in many respects. He envisioned logics in every home, linked through a distributed system of servers (called "tanks"), to provide communications, entertainment, data access, and commerce; one character says that "logics are civilization."

"The Lottery" Shirley Jackson (1948)

Jackson was known for writing mystery and horror and this story strays as far as any on this list from what's usually considered science fiction. (This story was published in The New Yorker and few of her short works were in traditional science fiction magazines.) "Lottery in June, corn be heavy soon." To say much more is to probably give too much about this powerful short story away. To quote Martin Cahill: "If you asked anyone about a American short story that stuck with them for their entire lives, it would not shock me if they were to think for a moment, and then say, 'that one story, ‘The Lottery,’' followed up with some form of, “'that shit is fucked up.'” Many of her best stories appear in the collection The Lottery and Other Stories.

"The Little Black Bag" C. M. Kornbluth (1950)

One might say that this story shares a similar premise with "Mimsy were the Borogoves" in that an object, in this case, a doctor's little black bag, gets sent back in time. However, suffice it to say that this is not an equally playful story. Kornbluth's classic works are this story and its sequel "The Marching Morons." However, he was a prolific author and his other works include "Two Dooms" which is considered to be one of the better What if the Nazis Won WWII treatments.

"There Will Come Soft Rains" Ray Bradbury (1950)

Bradbury's work has a poetic and evocative style that can tend towards fantasy and horror as much as science fiction. Charlie Jane Anders, who appears later on this list, had this to say about this particular story: "But this one, in which basically a smart house keeps going after its human inhabitants are all dead, is in a special league in the knife-twisting sweepstakes. Like a lot of stories in the years following World War II, it's concerned with the threat of nuclear annihilation, but also with how our technology might outlive us." This story appears in The Martian Chronicles, which is Bradbury's greatest work and you should just read the whole thing even if you're not a particular Bradbury enthusiast. But if you're looking for a single more Martian-themed story in that collection of linked stories, give "The Third Expedition" a try.

"Pillar to Post" John Wyndham (1951)

A number of Wyndham's best known novels have been described as cozy catastrophe fiction, a trait shared with a number of British authors of the same general period of which Wyndham was probably the best practitioner. In Wyndham's case, it's books like Day of the TriffidsThe Chrysalids (Re-Birth), and The Midwich Cuckoos--which have never had the film treatment that they deserve. However, in The Seeds of Time in particular, Wyndham also collected short stories which often dealt with time travel and other forms of displacement. The best may be this story which Wyndham described as "written to suit, I hoped, the policy of a newly arisen American magazine." A more whimsical tale in the same book is "Pawley's Peepholes," written the same year.

"Surface Tension" James Blish (1952)

During the 1950s, Blish wrote his Okie stories which envision a time when earthbound cities take to migrant wandering among the stars. Epic in scope, these stories were eventually wrangled into a single volume, Cities in Flight. During the same period, he was writing short stories of which "Surface Tension" is my favorite. The story concerns the events that follow after a spaceship crew genetically engineering their descendants into something that can survive after the ship crashlanded on a planet with only puddles of water. The miniaturized descendants must overcome surface tension if they're to get beyond their single puddle. Other well-regarded Blish short stories include "Common Time."

"It's a Good Life" Jerome Bixby (1953)

This story, more horror than science fiction, was the basis of a particularly good episode of the original Twilight Zone; it also has led to various remakes and riffs that played off of the idea including an episode of The Simpsons. At the center of the story is Anthony Fremont, a three-year-old boy with near-godlike powers; he can transform other people or objects into anything he wishes, think new things into being, teleport himself and others where he wants, read the minds of people and animals, and even revive the dead. As Anthony can read minds, the town's population must not only act content with the situation when near him, but also think they are happy at all times. 

"Fondly Fahrenheit" Alfred Bester (1954)

This is a breathless story of a man and his android whose personalities intermesh to become two aspects of a single insane murderous personality. Author Robert Silverberg has described it as a "paragon of story construction and exuberant style" which is what really makes it stand out on this list. Other Bester short stories of particular note are "Adam and No Eve" and "The Men Who Murdered Mohammed."

"The Cold Equations" Tom Godwin (1954)

James Davis Nicoll writes: "Science fiction celebrates all manner of things; one of them is what some people might call 'making hard decisions' and other people call 'needless cruelty driven by contrived and arbitrary worldbuilding chosen to facilitate facile philosophical positions.'” Which pretty describes this story. I'm making something of an exception by including in that it's contrived and I don't much like it. But it's been anthologized so often it's really part of the canon, so here it is. 

"The Star" Arthur C. Clarke (1955)

Clarke is one of the authors on this list--two others, Asimov and Heinlein, are coming up shortly--who produced such an astonishing volume of quality short stories that picking just one is really impossible. But here we are. I give "The Star" the nod because there's deeper emotion than in much of Clarke's work. It's hard to say too much about this story without giving things away. Let's just say it concerns an expedition that has discovered the remnants of an advanced civilization destroyed when its star went supernova. Other favorite Clarke shorts include "The Nine Billion Names of God," "The Wall of Darkness," "Rescue Party," and "Meeting with Medusa." I might also throw in "The Sentinel" but mostly because it was the inspiration for the film 2001: A Space Odyssey.

"Fiat Homo" Walter M. Miller Jr. (1955)

This one is a bit of a cheat. In the early 1950s, Miller published a series of short stories which would shortly be combined and reworked into A Canticle for Leibowitiz, his only novel and the work for which he is known. A Canticle for Leibowitz is arguably the best post-apocalyptic work of science fiction and differs significantly from the more common "Mad Max" model. The novel is set in a sort of Dark Ages hundreds of years after a holocaust and tells its story from the point of view of monks preserving knowledge as in the previous Dark Ages. The reworked "Fiat Homo" makes up the first part of Canticle and is arguably the strongest but, in practice, it's the full novel that you'll read. 

"Allamagoosa" Eric Frank Russell (1955)

This anti-bureaucratic satire meets shaggy dog story, which won the Hugo prize, was one of a number of quirky short stories that Russell wrote which were good examples of science fiction humor of the period. He also wrote a variety of other satires and anti-war stories in the immediate aftermath of WWII.

"Time in Advance" William Tenn (1956)

While not especially well-known (he never won a science fiction writing award), Tenn, the pseudonym of Philip Klass, wrote sharp-witted stories, often with a darkly comic side. This story, written fairly near the end of his active writing career, is set in a far future where a law has been passed enabling citizens to serve out sentences for crimes they intend to commit, serving the full term, but with a 50% pre-criminal discount. When two such pre-criminals return to earth intending to carry out the crimes they've earned, things don't go as planned. "The Brooklyn Project" is another story worth your time and was pretty much a toss-up with this one.

"The Last Question" Isaac Asimov (1956)

Asimov himself suggested that this was one of his favorite short stories. "I got the idea all at once and didn't have to fiddle with it; and I wrote it in white-heat and scarcely had to change a word. This sort of thing endears any story to any writer," he once wrote. It really is almost a perfect idea-based science fiction short story. It deals with the development of a series of computers called Multivac and their relationships with humanity through the courses of seven historic settings, beginning on the day in 2061 when Earth becomes a planetary civilization. In each of the first six scenes a different character presents the computer with the same question; namely, how the threat to human existence posed by the heat death of the universe can be averted. It's tight, it's funny, and it's got a killer ending. His novella "Nightfall" is also wonderful (the expanded novel version less so, as is often the case) but I think this short story gets the nod. One or more of his Robot stories could make their way onto this list as well but I think of them as more of a group achievement award than individual standouts.

"All You Zombies" Robert Heinlein (1959)

This story involves time travel paradoxes and further explores themes introduced in Heinlein's earlier "By His Bootstraps." In his analysis of the story, Davi Ramos writes that "Individualism and the free expression of love and sexuality are among its main themes. The work analyzed here pushes the boundaries of causality to mind-bending extremes, in order to discuss the boundaries of sexuality and the logic of identity." The narrative flow is complex and you probably won't totally get it on your own the first time around. The 2014 film Predestination is based on this story. Some other short stories I'd put on the list are "The Unpleasant Profession of Jonathan Hoag" and many of the stories collected in The Past Through Tomorrow future history including "Requiem" and the prequel to his Lazarus Long immortality saga Time Enough for Love, "Methuselah's Children."

"Flowers for Algernon" Daniel Keyes (1959)

Algernon is a laboratory mouse who has undergone surgery to increase his intelligence. The story is told by a series of progress reports written by Charlie Gordon, the first human subject for the surgery, and it touches on ethical and moral themes such as the treatment of the mentally disabled. The short story was later expanded into a novel and made into the film Charly (for which Cliff Robertson won the Oscar for Best Actor) and many other adaptations but I think the original story is still the most effective. 

"Chronopolis" J. G. Ballard (1960)

Ballard probably became best known (whether people knew his name or not) for his war novel, Empire of the Sun, a semi-autobiographical account of a young British boy's experiences in Shanghai during Japanese occupation, because Stephen Spielberg later made into a film. But he also had a career as a science fiction author which spanned the "world destroying" genre (The Drowned WorldThe Wind from Nowhere), like other British authors such as John Wyndham, to experimental efforts some of which were adapted into films such as David Cronenberg's Crash. He also wrote some enticing short stories. One of them is "Chronopolis" which begins with a man in prison, Newman, and proceeds to examine his fascination with the concept of time in a world where clocks have been prohibited and are regulated by time police. Other Ballard shorts that aren't too experimental include "The Drowned Giant," "The Overloaded Man," and perhaps the most conventionally SF "Thirteen for Centaurus."


"The Lady Who Sailed the Soul" Cordwainer Smith (1960)

The nom de plume of Paul Myron Anthony Linebarger, Smith (not to be confused with E. E. Doc Smith of Lensman fame) wrote relatively little, in part because he held jobs that required extensive foreign travel. Most of his science fiction was in the Instrumentality Universe and author Frederik Pohl described his stories as "a wonderful and inimitable blend of a strange, raucous poetry and a detailed technological scene, we begin to read of human beings in worlds so far from our own in space in time that they were no longer quite Earth." This story is one of his more lyrical works. It's adjacent in timeline to "Scanners Live in Vain" which is another Smith story written ten years earlier near the beginning of his science fiction writing. While Scanners is often cited as Smith's best work, I prefer the more modern and poetic feel of this story.

"Harrison Bergeron" Kurt Vonnegut Jr. (1961)

Although Vonnegut was a mainstream author, whatever that means exactly, many of his novels contained fantastical or science fictional elements whether the Ice Nine of Cat's Cradle, the time displacement of Slaughterhouse Five, or just about anything related to The Sirens of Titan. The premise of this story is that amendments to the Constitution dictate that all Americans are fully equal and not allowed to be smarter, better-looking, or more physically able than anyone else. The Handicapper General's agents enforce the equality laws, forcing citizens to wear "handicaps" such as masks for those who are too beautiful, loud radios inside the ears of intelligent people that disrupt thoughts, and heavy weights for the strong or athletic.

"A Rose for Ecclesiastes" Roger Zelazny (1963)

This is another one of those stories that the reader is probably best discovering on their own. It involves the Biblical book of Ecclesiastes, language, Mars, and prophesy and I should probably leave it at that. This story was an early career work for Zelazny who would go on to write many novels, most notably Lord of Light and his Amber series.

"'Repent, Harlequin!' Said the Ticktockman" Harlan Ellison (1965)

I had the pleasure of seeing Ellison speak a couple of times when I was an undergrad and he was simultaneously both entertaining and thought-provoking. If I'm being honest though, I've tended to admire rather than love many of his short stories. That said, "'Repent, Harlequin!' Said the Ticktockman" opens with a passage from Civil Disobedience by Henry David Thoreau and is a satirical look at a dystopian future in which time is strictly regulated and everyone must do everything according to an extremely precise time schedule. And breaking the law has severe consequences. Another perpetual Ellison favorite is "I Have No Mouth, and I Must Scream."

"The Stone Place" Fred Saberhagen (1965)

Saberhagen wrote a variety of science fiction and fantasy but he became best known for his Berserker series of stories and novels. Berserkers are interstellar killing machines, programmed to eliminate all forms of life, that presumably destroyed their creators in a long-ago war. This is another one of those cases where picking out individual stories is at least somewhat challenging but this one is a good place to start that doesn't really require additional context. "What T and I Did" and "Masque of the Red Shift" are additional stories of particular note, also from his initial Berserker collection.

"Light of Other Days" Bob Shaw (1966)

With Shaw we return to a writer, who in spite of a body of work, is mostly known for a single story and, to a lesser degree, its sequel "Burden of Proof" and an associated novel, Other Days, Other Eyes. The melancholy "Light of Other Days" builds on the idea of "slow glass," glass through which light takes years to pass, to explore the preservation of the past into the present.

"We Can Remember it for you Wholesale" Philip K. Dick (1966)

Dick's fiction explored varied philosophical and social themes, and featured recurrent elements such as alternate realities, simulacra, monopolistic corporations, drug abuse, authoritarian governments, and altered states of consciousness. He was prolific but a number of his works were arguably more successful as screen adaptations than in their original print form. This story about memory implants and the nature of reality stands well by itself but also was the basis for the 1990 film Total Recall directed by Paul Verhoeven and starring Arnold Schwarzenegger--which is probably best interpreted in light of its original source material. Novels The Man in the High Castle (adapted as an Amazon series) and Through a Scanner Darkly (made into a generally less successful 2006 rotoscoped movie) are also particularly recommended.

"Neutron Star" Larry Niven (1966)

Niven is best known for his hard-science Known Space series populated by imaginatively-drawn strange aliens and exotic technologies in a far-future. This story is the first to feature Beowulf Shaeffer, the ex-pilot and reluctant hero of many stories. It also marked the first appearance of the nearly indestructible General Products starship hull, as well as its creators, the Pierson's Puppeteers, a cowardly but advanced race that have an appearance somewhat in common with centaurs. Shaeffer's mission is to explore a neutron star and things go wrong; it turns out the science in the story in the story isn't quite right but it's still a great example of Niven's work. Niven's shorts tend to be stronger than his solo-authored novels. Many of the stories in the known space series are good reads, including those in the collection named after this story, Neutron Star. Outside the Known Space universe, "Inconstant Moon" is arguably his best if just picking stories in isolation.

"The Fifth Sally or The Mischief of King Balerion" Stanislaw Lem (1967)

The widely-translated Lem is the author of Solaris, which has been filmed three times, including as a famous Soviet-era art film co-written and directed by Andrei Tarkovsky in 1972. In addition to essays, he also wrote often humorous and satirical science fiction; he's sometimes said to have worked in the same vein as Swift and Voltaire. The Cyberiad brings together independent--but largely linked through the characters of the brilliant robotic engineers Trurl and Klapaucius--stories that take place in a pseudo-medieval world. You'll really want to read the whole book but you can start with this story or perhaps the longer "Tale of the Three Storytelling Machines of the Genius."

"Aye, and Gomorrah" Samuel Delany (1967)

This first appeared as the final story in Harlan Ellison's seminal 1967 anthology, Dangerous Visions. It was controversial because of its disturbing sexual subject matter although, like many of the stories in that anthology, stories that pushed the envelope in 1967 don't necessarily do so today. The narrative involves a world where astronauts, known as Spacers, are neutered before puberty to avoid the effects of space radiation on gametes. Aside from making them sterile, the neutering also prevents puberty from occurring and results in androgynous adults whose birth-sex is unclear to others. Spacers are fetishized by a subculture of "frelks" attracted by the Spacers' lack of arrousability.

"Kyrie" Poul Anderson (1968)

A love story involving a human woman, a luminous energy being, and a black hole might not sound too appealing at first glance but this is probably my favorite Anderson short of which there are many. (Along with novels of which the immortality tale The Boat of a Million Years tops my list.) Among shorter works, the novelette "Goat Song" and "The Saturn Game" novella are also especially worth checking out.

Anthony Burgess "The Muse" (1968)

A literary critic, mostly comic writer, musician, and linguist, Burgess is probably best known for his dystopian satire A Clockwork Orange which Stanley Kubrick made into a controversial but critically acclaimed film. This time-travel-with-a-twist story is both a shorter and a smaller work but, if you can track down a copy, is well-worth the quick read.

"Weihnachtsabend" Keith Roberts (1972)

Generally regarded as Roberts' single best story, this depicts an alternate world in which the Nazis won WWII and expands upon some the savage German myths implicit in that victory. Roberts is also known for Pavane, a fix-up novel of linked stories imagining a victorious Spanish Armada that results in a technologically backward Catholic England.

"Alien Stones" Gene Wolfe (1972)

Concerning Wolfe, The Encyclopedia of Science Fiction uses phrases such as "he created texts which–almost uniquely–marry Modernism and Genre SF" and "Wolfe remains quite possibly sf's most important author qua author." Which, is to say, he can be more than a bit challenging to read. I found this first contact story to be one of his more accessible works for reasons both of content and length. The collection where it appears, The Island of Doctor Death and Other Stories and Other Stories, is a good Wolfe starting point in general. His novella, The Fifth Head of Cerberus, which appears in a collection of the same name, also has many fans but it's intricately linked with the other two novellas in that collection so isn't really a standalone work.

"Eurema's Dam" R. A. Lafferty (1972)

Lafferty was always something of an enigma who didn't fit neatly into science fiction or fantasy categories. A "teller of tall tales" was one valid lens through which to view him although there were others including that of conservative Catholicism. That said, he won a Hugo for this story which editor Robert Silverberg described as a "story about a schemiel of an extraordinary sort" but which Lafferty himself apparently didn't especially favor. Other notable stories including "In our Block," "Narrow Valley," and "Thus We Frustrate Charlemagne" appear in the long out-of-print Nine Hundred Grandmothers; a new Lafferty collection is supposedly appearing in 2021.

"The Ones Who Walk Away from Omelas" Ursula Le Guin (1973)

Le Guin wrote over a course of almost 60 years to a variety of audiences in a variety of genres. This story is essentially philosophical fiction that explores a summer festival in the utopian city of Omelas, whose prosperity depends on the perpetual misery of a single child. Another, longer, Le Guin story "Buffalo Gals, Won't You Come Out Tonight" recounts a human girl's meeting with incarnations of Native American spirit animals and appears in an eponymous collection. Other LeGuin works such as "Vaster than Empires and More Slow" and the novel The Word for World Is Forest examine the relationship between humans and their natural environment. "The Day Before the Revolution" is considered a short story prologue to The Dispossessed, which is my favorite novel of hers; it's about an anarchist society. 

"He Fell into a Black Hole" Jerry Pournelle (1973)

Jerry Pournelle was a writer of typically military science fiction, essayist on science topics, editor, and creator of essentially a proto-blog in Byte magazine. This story is set in Pournelle's CoDominium universe where the US and the USSR have formed a de facto planetary government and then interstellar empire. Pournelle also co-authored a particularly noteworthy hard science novel with collaborator Larry Niven--A Mote in God's Eye. Shorts "Motelight" and "Reflex" were carved out of that book prior to publication.

"Where Late the Sweet Birds Sang" Kate Wilhelm (1974)

This story is the first of three linked stories later published as a novel of the same name in 1976. It takes  place as civilization is collapsing; an isolated group prepares for this largely infertile post-collapse world by undertaking a cloning program. Wilhelm wrote novels and stories in the science fiction, mystery, and suspense genres over the course of a long career. Another story especially worth checking out is "The Girl Who Fell into the Sky," which is more supernatural than SF but did win a Nebula for best novelette.

"Catch that Zeppelin" Fritz Leiber (1975) 

This is a clever alternate history take that imagines a more decisive defeat of Germany at the end of the First World War. Although more fantasy than science fiction, the novelette "Gonna Roll the Bones" in Ellison's Dangerous Visions anthology also won Hugo and Nebula awards.

"Houston, Houston, Do You Read" James Tiptree Jr. (1976)

This novella is another one of those stories where just about any description would shortchange readers wanting to experience it without knowing what it's really about and where it's headed. Tiptree was the pen name used by Alice Bradley Sheldon from 1967; her real identity wasn't widely-known but was generally assumed to be that of a man until it leaked out shortly after this story was written. (Although there was speculation, based partially on the themes in her stories including this one, that Tiptree might be female.) In any case, this is an interesting story that won both Hugo and Nebula prizes, even if the gender and social stereotypes seem dated for the time it was written.

"Ender's Game" Orson Scott Card (1977)

This story gave birth to a series of novels, starting with a novelization of "Ender's Game" and leading to a series of novels. While the first sequel, Speaker for the Dead, was quite excellent in its own right the initial short story shines brightest in my opinion. It begins with Ender being made the commander of Dragon Army at Battle School, an institution designed to make young children into military commanders against an unspecified enemy. Armies are groups of students that fight mock battles in the null gravity Battle Room. Due to Ender's genius in leadership, Dragon Army dominates the competition. Go ahead and read the story. (But don't bother with the film.)

"The Guy with the Eyes" Spider Robinson (1977)

In general, I've tried to pick standalone stories for this list. This one works fine in that vein but it's really here as the first entry in the linked stories that make up Callahan's Crosstime Saloon stories; they've been collected into a number of books beginning with Callahan's Crosstime Saloon. The stories are filled with strange or unusual events and visitors and are an obvious homage to Fletcher Pratt and L. Sprague de Camp's Tales from Gavagan's Bar and Arthur C. Clarke's Tales from the White Hart.

"Sandkings" George R. R. Martin (1979)

Martin is, of course, best known for his series of epic fantasy novels A Song of Ice and Fire, which were adapted into the HBO series Game of Thrones. However, before this breakout, he had written a variety of stories that mixed fantasy, horror, and science fiction of which "Sandkings" is a clear example. It certainly includes sensibilities that will be familiar to Game of Thrones viewers. Suffice it to say that Martin was supposedly inspired by a college friend at Northwestern University who had a piranha tank and would sometimes throw goldfish into it between horror film screenings. (This explains a great deal about Martin.)

"Riverworld" Philip Jose Farmer (1979) 

This shorter piece can serve as a good introduction to Farmer's multi-volume Riverworld series which is set on a planet where a godlike race has resurrected the whole of humanity along the banks of a river that sinuously circles around and around a world. Another well-known Farmer work is "The Lovers" but, while originally a novella, is usually read in the expanded novel form. His novella "Riders of the Purple Wage" imagines a society with basic income and total sexual freedom.

"Grotto of the Dancing Deer" Clifford D. Simak (1980)

This was one of Simak's last short stories and won Hugo, Nebula, and Locus awards; it shows off his skills at their strongest.  It's a archaeo-sci-fi tale that's brilliantly-written, moving, and slowly pulls you into something of a mystery.

"The Gernsback Continuum" William Gibson (1981)

This is probably an unconventional choice. "Burning Chrome" or "Johnny Mnemonic," associated with his Sprawl trilogy, would probably be more more conventional picks for Gibson short stories. But I think this story is actually more central to cyberpunk. As Bruce Sterling writes "'The Gernsback Continuum' shows [Gibson] consciously drawing a bead on the shambling figure of the SF tradition. It's a devastating refutation of 'scientifiction' in its guise as narrow technolatry." It takes down the glimmering science fictional cities in which zeppelins rule the airways.

"True Names" Vernor Vinge (1981)

This novella doesn't have the gritty ambiance but it's still a seminal work of the cyberpunk genre. In 2001, The New York Times declared that Vinge's depiction of "a world rife with pseudonymous characters and other elements of online life that now seem almost ho-hum" had been "prophetic." I'd add that we don't use the true name term, which is to say the tying of someone's online identity to their identity in the real world, as much as we should; it's a great concept. He subsequently wrote novels that explored a future libertarian society and the impact of a technology which can create impenetrable force fields called 'bobbles' but is probably best known for his 1992 novel A Fire Upon the Deep and, to a lesser degree, its sequels. A newer story that deals with a similar topic to "True Names" updated is "Fast Times at Fairmont High," which can be viewed as a sort of pilot for his Rainbows End novel.

"The River Styx Runs Upstream" Dan Simmons (1982)

Although his Hyperion Cantos series of (primarily) novels are science fiction, much of Simmons' output is horror and this story certainly bridges the genres. This was the story Simmons published after attracting the attention of Harlan Ellison at a writing workshop. It imagines a world in which "Resurrectionists" can technologically revive family members but, while the resurrected can function somewhat autonomously, they no longer have higher brain functions. Many of Simmons' short stories are in the collection Prayers to Broken Stones, which also includes "Remembering Siri," originally a part of the aforementioned Hyperion

Greg Bear "Blood Music" (1983)

Originally a novelette, later expanded into a (less good) novel, this story combines "man's creation gone wrong" with an evolutionary transcendence theme. Whether or not this story kicked off nanotechnology as a subject for science fiction as is sometimes claimed, it was certainly an early and prominent example.

"Press Enter ▮" John Varley (1984)

Written a few years after Vinge's "True Names," this is a very different story but concerns some of the same themes related to developing connected computer networks. This story has been the more reprinted of the two stories, perhaps because of its harder edge. "The Persistence of Vision" is another Varley story that won most of the major science fiction awards. 

"Bloodchild" Octavia Butler (1984)

Set on an alien planet, this story depicts the complex relationship between human refugees and the non-humanoid aliens who keep them in a preserve to protect them. Themes of co-existence and breeding appear throughout much of Butler's writing, including the Xenogenesis trilogy that came out during the five years following this story.

"The Crystal Spheres" David Brin (1984)

The Fermi paradox, named after physicist Enrico Fermi, refers to the apparent contradiction between the lack of evidence for extraterrestrial civilizations and the many estimates that suggest such civilizations should be commonplace in a very large and old galaxy and universe. This story postulates a solution, the starting point of which is that every habitable solar system is surrounded by a "crystal sphere" which can only be broken from the inside--once a civilization has the technology to do so. Another good Brin short story is "The Giving Plague" but I figured there were already enough stories with a plague component on this list given the times.

"The Road Not Taken" Harry Turtledove (1985)

Turtledove has been a prolific alternative history author although it's mostly hard to pick out standout individual stories. However, this one is as good a choice as any even if the inspiration for the title, a Robert Frost poem, is mostly misinterpreted as in this case. It's the prequel to "Herbig-Haro," published the year before. Guns of the South is a notable alternate history Civil War novel by Turtledove that I recommend in part because it's standalone while many of his series go on through many books. 

"Schrödinger's Kitten" George Alec Effinger (1988)

Partially sharing the same setting as a number of his novels, this novelette follows a Middle-Eastern woman, Jehan Fatima Ashûfi, through various realities. She perceives these realities as "visions" and assumes they might come to her from Allah. The realities correspond to a form of the many worlds interpretation of quantum mechanics, and the story's title comes from the Schrödinger's cat thought experiment.

"Many Mansions" Alexander Jablokov (1988) 

This funny inventive tale imagines that, given that religion is the opiate of the masses according to Karl Marx, why wouldn't one smuggle it? I went to grad school with Alex and we were briefly housemates. Another particularly recommended short story is "At the Cross-Time Jaunter's Ball" along with other stories mostly collected in The Breath of Suspension.

"Axiomatic" Greg Egan (1990)

In this story, which appears in a collection of the same name, the protagonist enters a store selling mods not only for every variety of psychedelic experiences, but for altering one's personality traits, sexual orientation, and even religion. The protagonist seeks a custom-made mod that will suspend his moral convictions long enough for him to murder his wife's killer. All the stories in the collection delve into different aspects of self and identity.

"Even the Queen" Connie Willis (1992)

This short story falls squarely on the comic side of Willis' production. The Village Voice called it "a comedy of identity politics and mother-daughter relations" and it's as good an introduction as any to Willis' light-hearted and sometimes madcap writing. She also has a more more somber, even tragic, side with stories such as "The Last of the Winnebagos" and "A Letter from the Clearys." "Fire Watch" is a short story introduction to her works that feature time travel by history students and faculty of a future University of Oxford; noteworthy novels in that series are Doomsday Book and the To Say Nothing of the Dog.

"Story of your Life" Ted Chiang (1998)

Although the decline of science fiction magazines has arguably helped lead to a decline of shorter science fiction overall, the well-awarded Chiang has never written a full-length novel. Moviegoers may recognize this novella as the basis for the 2016 film Arrival. (The film keeps the basic structure of the story but adds what are probably best described as Hollywood elements.) The story is narrated by linguist Dr. Louise Banks who is called in to communicate with alien visitors. It brings in questions of free will and the nature of time but it's another story that rewards discovering its structure on your own. Chiang has many fine works but particularly noteworthy is the novella "The Lifecycle of Software Objects" and the short story "Tower of Babel."

"Taklamakan" Bruce Sterling (1998)

Sterling is one of the founders of the cyberpunk movement in science fiction. Simone Caroti calls this story "an intelligent reworking of the generation starship concept for the information age" (which it combines with an espionage angle). This story is one of Sterling's loosely linked Chattanooga stories of which "Bicycle Repairman" is also particularly recommended. Among his Shaper/Mechanist stories, "Cicada Queen" is a good place to start.

"The Janitor on Mars" Martin Amis (1998)

Amis is a British writer who has written very little science fiction; indeed this story, which was originally published in The New Yorker, is the only science fiction in the Heavy Water and Other Stories collection where it appears. A robot makes contact from Mars and reveals the  truth of mankind's place in the Universe. It's funny and melancholy at the same time. 

"A Colder War" Charlie Stross (2000)

This alternate history novelette fuses real and inspired-by characters and events of the Cold War and H. P. Lovercraft's Cthulhu Mythos. It's a thoroughly imaginative mash-up though your reading will probably benefit by some familiarity with Lovecraft's work. He also examines the Cold War in his 2006 novella "Missile Gap." "Rogue Farm" imagines a world of biological fabricators, eight legged cows, talking dogs, microscopic surveillance bots, mid-life genetic upgrades, and something akin to Larry Niven's stage trees.

"The Fluted Girl" Paolo Bacigalupi (2003)

Bacigalupi often explores the effects of bioengineering, water shortages, and fossil fuels no longer being viable. His short stories are collected in Pump Six and Other Stories which are collectively memorable but bleak. This story starts with the title character "huddled in the darkness clutching Steven’s final gift in her small pale hands. Madam Balarie would be looking for her. The servants would be sniffing through the castle like feral dogs." Other stories in the volume, probably best read with appropriate spacing like episodes of "Dark Mirror," include the novelette "The People of Sand and Slag" and the novella "Pump 6."

"Beyond the Aquila Rift" Alastair Reynolds (2005)

Two short stories by Reynolds were the basis of a couple of the better episodes in the (recommended) Netflix anthology series "Love, Death & Robots." One of them was this one about a space jump gone wrong. The other was "Zima Blue." Other stories in the eponymous collection are worth checking out in addition to the longer novella "Diamond Dogs" set in Reynolds' Revelation Space universe.

"The Egg" Andy Weir (2009)

This was about a thousand word story that Weir describes as something he pounded out in about 40 minutes. It's a fun little story so I don't think I'm including it unreasonably but its viral popularity also helped lead to Weir's success with his hard science fiction novel The Martian, which was made into a popular Hollywood movie. 

"The Fermi Paradox is our Business Model" Charlie Jane Anders (2010)

This story is a fun take on why the previously mentioned Fermi Paradox might be the result of deliberate outside actions. Aliens may be involved. And they may not be benevolent. Anders has also won a Hugo for her novelette "Six Months, Three Days."

"Sinners, Saints, Dragons, and Haints in the City Beneath the Still Waters" N. K. Jemisin (2010)

Much of Jemisin's writing concerns cultural conflict and oppression. This story is set in the Ninth Ward of New Orleans in the aftermath of Hurricane Katrina. Heather Rose Jones writes that "What makes this story great is the immersive voice and language, the way descriptions of everyday surroundings slide easily into the fantastic, and the way the folklore of cities and peoples is woven into a new mythos." Many of Jemisin's shorts are collected in How Long 'til Black Future Month?

"Mono No Aware" Ken Liu (2012)

This touching Hugo-winning story is about a ship fleeing the destruction of earth as told through Hiroto Shimizu's attempt to teach someone else the Japanese culture even if he himself doesn’t know much about it anymore. Liu's "The Paper Menagerie" is even more awarded but I didn't care for it as much as this one. I also particularly like "Perfect Match."

"Curse 5.0" Liu Cixin (2013)

Liu Cixin is best known for his novel, The Three-Body Problem, and its sequels. This short story is distinguished by its dark humor concerning the life of a computer virus. The same collection also contains longer stories such as "Mountain," about alien first contact, and "The Wandering Earth," which became the basis for the first big-budget Chinese science fiction blockbuster. At least some of Liu's work is reminiscent of earlier science fiction authors like Arthur C. Clarke where the focus is more on exposition than characters.

"Inventory" Carmen Maria Machado (2013)

This is yet another story about which I hesitate to say much of anything. It's more literary than genre and to even say why it's connected to science fiction would be to cheat the reader.

"Ambiguity Machines: An Examination" Vandana Singh (2015)

In this story, we learn of machines that blur boundaries and confound the laws of physics. It is presented with three loosely-linked stories of impossible machines in remote areas of the earth which characters hope to use to be reunited with a person they love or to find their way home. Vandana Singh has a unique style about which Matthew Cheney writes "history, myth, science, and storytelling all infuse each other while the personal and cosmic sit side by side." This story appears in the collection Ambiguity Machines and Other Stories whose stories play off of each other in various ways although you can read them standalone.

"Thirteen Ways of Destroying a Painting" Amber Sparks (2016) 

One reviewer described the collection in which this story appears as "an off-kilter universe of almost-fairy tales with equal parts beauty and melancholy.” This is a time travel story but one told in a very original and very spare way. Another favorite is "Cemetery for Lost Faces," likewise in the collection The Unfinished World: And Other Stories. Many of Sparks' stories have science fiction or fantastical elements although her writing is broader than that.

"The Ghost Ship Anastasia" Rich Larson (2017)

I like a Reddit blurb on this: "Drugs, bioships, and batshit AI in a deep space horror/love story." Like Bacigalupi, Larson strongly tends towards the dark side; see also "Painless." But he's a relatively young author whose work appears in numerous Year’s Best anthologies and is well-worth perusing.

Some of the text in this post is adapted from Wikipedia and The Encyclopedia of Science Fiction by John Chute and Peter Nicholls.

Hacker News thread on earlier 50 author version: https://news.ycombinator.com/item?id=23959648

Friday, October 02, 2020

Infrastructure as code management with env0's Ohad Maislish




Env0 provides IaC tools for hybrid and multicloud environments. Although public cloud costs often get cited as an issue, cloud costs are mostly treated as an operational concern that developers don't have visibility into. Env0 works with the open source Ansible and Terraform projects to provide better cross-cloud cost visibility. Env0 also recently open sourced Terratag, which lets Terraform users automatically and recursively tag cloud resources across their entire set of AWS, Azure, and GCP resources.

In this podcast, CEO and co-founder Ohad Maislish discusses:
  • Enabling developers
  • Why many organizations don't want to be tied to a single public cloud
  • Challenges in hybrid cloud and multicloud environments
  • The open source Terratag project

Tuesday, August 25, 2020

Red Hat's William Henry on grid, containers, and orchestration

William Henry is a senior distinguished engineer at Red Hat who has been involved with open source since Slackware. Part of this involvement included the development of open source grid software such as Condor.

In this podcast, we discuss:

  • How supercomputing has evolved
  • What grid software was designed to do
  • How container orchestration and grid did and do relate
  • Why containers for HPC

[Transcript]

Gordon Haff:  This is Gordon Haff, technology evangelist with Red Hat, for another episode of the "Innovate @Open" podcast. Today, we're going to talk about containers, grid, high performance computing, container orchestration and more.

I have with me my colleague, William Henry, who has a whole lot of experience in this area.

William, why don't you introduce yourself?

William Henry:  I am William Henry. I'm a distinguished engineer at Red Hat. I had multiple roles with Red Hat over my last 12 years here. One of the exciting times that I had was as Red Hat were transitioning from essentially a Linux platform company to an expanded role within enterprises and adding value on top of Linux with some other open source projects in the area of messaging and real time, Linux, and grid.

Gordon:  Let me start this off with a little bit of context setting because the term grid has been used throughout computing history for a number of different things, including, for instance, some of the early peer to peer computing.

To be clear, when I'm talking and we're talking about grid here, we're really referring to it in the sense of high performance computing, resource management, and scheduling.

William, can you take us through some of the history of this technology?

William:  From my perspective, it was a breakaway from the whole large supercomputer based approaches. As very large organizations either in the defense field or medical field or whatever, required huge amounts of computing.

As they started looking at the costs of supercomputing and noticing the pricing on the cheaper versions of this around distributed computing and they saw the growth of distributed computing along with networking technologies, etc., there was a shift from...there are certain problems we can try to solve by putting a lot of different processors to work across a network to solve problems.

That proved to be a very effective approach particularly within the areas of things like seismic analysis in the oil business or scientific analysis in the medical field, weather related stuff, and also in other areas of the military, and research areas. Then we saw move into things like the movie animation and CGI world, as well.

It was trying to solve a number of different problems. One was that distributed supercomputing problem. Then there was more about high throughput computing, on demand computing, which was more similar to what we're seeing now in some of the container world. Data intensive computing, and then also collaborative computing as well, working with scientific teams.

That's where I see it coming from. It's an evolution out of supercomputing to more cost effective at larger scale initiatives, and then moving from the scientific world into a more commercial based environment.

Gordon:  If you look at the list of the large supercomputers over the years, one of the things you saw, as we went from a world where these vector supercomputers dominated by the likes of Cray to network computers. Initially, these were often proprietary interconnects, or at least there was a real mass of different interconnects.

Large RISC systems and increasingly, though, you still do see RISC systems there as well, these are "commodity x86 systems" connected by a couple of standard interconnects, specifically Ethernet and InfiniBand.

William:  It was funny. I remember on a visit, it was 10 years ago, down to New Mexico to see a DreamWorks based rack system that they were using for doing animation. Seeing it in the same ex Intel prefab room, massive room in the corner beside the New Mexico supercomputer. The DreamWorks' one was much larger.

Gordon:  We fast forward to, I guess, maybe five years or so ago, containers are coming in    now containers, of course, being a technology that's been around for a long time but containers really becoming this very important technology for computing broadly.

Docker at the time was useful for developers on their laptops and small systems, but if you were going to have applications made up of hundreds, thousands of containers, there needed to be some job scheduling system, resource management system, what have you. As we all know, Kubernetes has become the dominant orchestration technology.

When this whole thing was jumping off, in fact, it wasn't clear that there was just one layer there because you had this orchestration layer as we tended to call it, that was Kubernetes. Then there was also this idea of resource management, which wasn't really quite the same thing. Can you talk a bit about that?

William:  This was one of the things I noticed early on. Although there was a lot of parallels to grid, and we're seeing those parallels moving much more closely together now that we're several years into the container technology based stuff, originally, you could see some differences.

With the large grid computing efforts, they were focused more on having a well defined cluster of resources that were quite often hardware based. Later on, we saw some virtualization and stuff coming into that, but for the most part, I have a large cluster of hardware, I can add it to that to cluster, etc.
Although that might be difficult depending on the grid technology I'm using, but really, I want to try to share those resources at the start within one organization, and then more broadly to multiple organizations.
You had the idea of trying to give a certain amount of resources, let's say, 20 percent of the resources to this particular research field, and another 10 percent of the resources to that field. Of course, originally, it would be just one group. I'm running this huge big job, I'm going to take over the supercomputer today, and do it.

Then it was like, hold on, how do we divvy it out, and provide fair shares between each of the different groups, while at the same time, building the different organizations as well. It started getting very complicated.

Most of the jobs, when you think of it, were very batch oriented. They were like, "I need to take over the grid today to run this particular large workload of batch computational stuff, or data intensive analysis work." Then, they evolved even more to, "I could set up a workflow of this work."

It's getting very complex with resource management, fair shares, costing back to different departments, because these were expensive resources. The idea of, data versus high computation, and also how do we get workflow into this.

That contrasted with what we saw originally in the container world which was essentially using a cluster of hardware completely abstracting that away into abstract concepts of CPU percentages, or whatever, or memory percentages, and trying to keep the workload up.

It was often about, "I want to be able to run this application which might have been a website, etc. I want to run it for forever. By the way, can you scale it up a bit on high demand and scale it back down again?" It was a different kind of workload on a similar concept of a cluster.

Back then, originally, it would be a very homogeneous set of machines. Then as different university resources were saying, "I could add our departments' computers over onto this grid technology for use." Then it started getting complex, in terms of, describing, "This is a particular type of chipset base. It's got this operating system running on it."

It also became very complex into, what type of workloads, where are you going to schedule. In other words, "I have this huge pool of resources, but my workload needs to run on Linux, or it needs to run on Solaris, or it needs this particular type of hardware base."

It became very complex in terms of the matchmaking efforts that were going on to get things up. This machine has GPUs. This machine has a desktop. Are we adding our desktops at night to the grid?
During the day, the animation artists are working on these machines, but at night, we don't want them idle. Are these Windows machines versus Linux machines? There was a huge amount of effort going into doing this crazy amount of matchmaking that the resource manager would have to do.
There was matchmaking. Then there was this idea of giving out and saying, "I'm going to give you a claim on that particular machine at this sort of time," or there was booking machines in advance kind of concepts.

It became very complex. Originally, there was very expensive applications that were doing this Platform LSF or things like that. Then there was efforts to try to do open source with taking an academic project like Condor from up in University of Wisconsin.

They had a Condor project. Red Hat helped open source that. The more we looked into it, we saw just, "This was fantastic stuff, hugely complex matchmaking capabilities." It was pretty amazing. We learned a lot on that. Then, of course, you had the container revolution.

Gordon:  Yeah. I love that. There was this huge vision around grid computing around 2000 or so where people imagined this kind of computing everywhere type of thing, as you say, peer to peer computing. Intel was very big on this. The Intel CTO at the time referred to ppeer-to-peer possibly going to be bigger than the Internet.

However, to come back to our earlier discussion, a lot of this ended up more consolidating into job scheduling across a large, fairly fixed cluster of computing resources. Fast forward, back to containers.

William:  Probably 2013.

Gordon:  Containers are getting big. They're becoming more widespread. You had Kubernetes coming onto the scene. You had a variety of other open source resource management projects out there, some of which were basically competitors to Kubernetes, others of which were probably closer to next generation HPC resource managers of various sorts.

Yet, today, we seem to have largely decided we're just going to do Kubernetes.

William:  Yeah. I was in the middle of this transition and caught a little bit on the wrong side of it at one point. Let me explain.

Having come from this grid technology background with Condor and working with some very large clusters    we're talking 25 30,000 nodes or whatever, doing massive amounts of work across multiple different movies and stuff in the animation world, for example    the container technology starts coming on. We already had our own scheduler.

Remember, when we started this with OpenShift and Red Hat, we had already started using containers, but they weren't the OSI model or the Docker model back then. They were just using raw Linux containers our way. We call the ability to start those cartridges. Then we had a technology called GearD, which was to schedule them.

It was all open source stuff, because that's all we do at Red Hat. It was our open source projects that we were hoping to get some backing on.

Very quickly, we saw the Kubernetes community jump on board with the Docker format at the time. Then Google introduced Kubernetes. We saw it. We saw similarities between its approach and the GearD approach.

We saw some advantages that it has concepts like the pods in Kubernetes that seem to make sense. We decided to jump on that.

Now, that technology was based on the use case that I mentioned earlier, which was around, how do we get developers building apps that are very consumer focused applications, web based applications? How do we get those up and running and keep them running in clustered environments of Linux resources?
That was our approach. When we saw Kubernetes, we jumped on board with that.

There was another technology around at the time that was popular, another project    an Apache project, it's still around    called Mesos, which had a bunch of frameworks on top of it that were looking at the ability to schedule workloads.

Also, at the same time, you had things like the Hadoop environment which were doing data intensive work.

There was a struggle at the start around which workloads are we going to be supporting. Can we support within the Kubernetes world this concept of very much, almost a batch oriented work, the workloads we were talking about earlier on the grid? There was a lot of tension there.

The tension was, where do we want to put our resources? Remember too, at the same time as Kubernetes is going, Docker themselves are introducing this concept of Swarm. Its project called Swarm, that it's some other juggling around as well. That would confuse people, didn't help them. I don't think a lot.
Kubernetes has started. Mesos is taking off. At that time, a Mesos world or Mesos fest or whatever it was called was much bigger than anything that was going on in the Kubernetes world. People were super excited about it and all of the different frameworks on top of that for doing the data intensive workloads.
Mesos is also looking at what Kubernetes is doing around clustering. There was a, "Where do we want to put these resources? Where do we want to put our engineering resources?"

Kubernetes is also looking at batch work. Remember, these batch workloads we talked about earlier are very complex. They're in what I would call workflows.

In other words, let's do this amount of analysis, thousand CPUs doing this analysis. If it was all successful, then scheduling the number of workloads needed to do to work on the output of that in the next step to doing the next step of a workflow, etc., then consolidating some results at the end. That whole workload stuff didn't have a place in Kubernetes.

They had the concept of getting an application up and keeping it up and scaling it up and down as needed, but essentially always having it running. This whole idea of the replication controller to make sure that we have this resource available.

Whereas if you think of it, the Kubernetes concept of a job was essentially saying, "Hey, let's run this, but it's OK if it dies. You don't have to keep it up." In other words, let it run to the end. If it dies, don't try to restart it because it's a job and you expect it to die. That's about as complex as it was getting on that.
At that time the Kubernetes community, and certainly Red Hat, decided we needed to not focus on the batch state analytics world. We really needed to win the battle within the Kubernetes world. Kubernetes was going to be the future.

At the time, there were certain large customers that we were looking at. We were looking at the Mesos world of numbers, trying to propose that we try to look at both of those. This is where I got caught on the wrong side of it. There was a certain amount of consensus to maybe we should support both Mesos and Kubernetes.

Thankfully, the folks on the OpenShift side of our house decided, "Nope. Kubernetes is it. Kubernetes is the future."

Kubernetes won at Red Hat and as we've seen, Kubernetes has won in the marketplace as well.
There's still a lot of workload that we can talk about that needs to be supported or is beginning to be supported from that grid side of the house. That old high performance computing side or our data intensive computing side, or whatever you want to call it. Still a lot of work to be done on that, but Kubernetes is going to happen there.

Gordon:  Why might you want to use containers in HPC?

William:  This is why I think you're going to see a much more increase, or you are seeing a larger increase of this in the HPC world. You can look around it from the AI machine learning perspective, which is where a lot of this is falling right now. But when you think of it, that's really sometimes complex algorithms on data. It's AI ML stuff is where those workloads are falling right now.
What happens is, with the container side of this, I get a much more flexible...All the matchmaking that we have to do before becomes a lot more simpler. It's all Linux for a start. It's all going to be running on an abstracted way, very homogeneous world of compute.

Let's look at this from a container perspective now, similar to what we did before. Remember, these scientists before were writing an application that they knew their environment, what their environment was. It was the job of the complex matchmaker to figure out how to schedule the jobs on the right machines. The application developer didn't care too much, because they were writing to their chosen platform.

In this container world, everyone's writing to the same platform, they are writing into Linux containers. There's a much greater pool of developers who are out there working on this. You can containerize your application and, therefore, provide more amount of agility, in terms of, updates around that.
The scheduling becomes very simpler, because really, all you're looking for now is the CPU memory type of slices that we're looking at. Maybe GPUs, depending on the type of workload. There's been a lot of work with the Kubernetes community around GPUs.

The idea of containerizing it allows the developer to have a lot of freedom, and it provides a much more homogeneous world for the scheduling of that workload. You're seeing then things like Open Data Hub, which are putting their machine learning and AI algorithms inside of the container world to run on this Kubernetes cluster.

Gordon:  One of the things we're seeing here is really part of a long ongoing story which is enterprise computing and HPC, which used to be totally different worlds, have been coming closer and closer together really for the last two three decades or so.

William:  It's fair to say, the world we're living in now where you bring the hybrid cloud infrastructure, along with containers with AI ML open source projects and all that good...It's like bringing the supercomputer to the masses.

Before, this was in the realm of large government, certain massive well funded research labs, or biotechnology labs, or whatever it might be. Now, if I'm a small company somewhere, I can bring up a number of resources on a public or private cloud, and run a workload on an open source AI ML. Suddenly, I have a supercomputer, just consumable on an hourly basis or whatever, at my fingertips.

Now, any department in an enterprise can quickly spin it up.

What I think is amazing is the speed, the type of effort and work that was done around this to get your workload up years ago on a grid computer. It was a large project and a huge effort. Now you're hearing about the campaign website approach to supercomputing problems.

I've been a little bit facetious there, but the idea that a small funded project can spin up an AI ML learning project on something. Then we're seeing it right now with the COVID 19 crisis, where everyone seems to be coming bringing to bear the grid or the Kubernetes concepts to bear on this problem at very low cost.

Gordon:  Maybe to close out, what do you see as next steps for Kubernetes orchestration in order to continue to accommodate these other kind of workloads which came from a different direction.

William:  All of the pieces are there, and certainly the knowledge is there across the communities that are involved in this thing. You're seeing the AI ML space. We know about distributed computing, we know about all of the different parts of this. The computer science part of this is already there in various areas.

What I'm seeing is the next step is streamlining. We're not at the automatic workflow from beginning to end with this. We're still pulling together some pieces.

Now, some enterprises have done this already, but, in terms of the mass model for this problem, out on the IoT devices connecting into your edge devices. Being consumed on the enterprise platform across hybrid cloud infrastructure, when all the scheduling, and the billing, and all that good stuff. All the pieces are there, but we still are doing these as projects that are different in every deployment at the moment, but it's becoming more similar.

Open source initiative that brings it all, obviously, I personally think it'll be in the Kubernetes community, but that brings that whole streamlining of this together in a cohesive manner as opposed to, let's pick this project here, and that project there, and then let's all work together and trying to connect them all.
It's great that it's open source, and it's great that they're open API. We can do it and it's going to be low cost. Great, but wouldn't it be nice to have that tie down for everybody right now.

Is that where you're seeing it too, maybe, Gordon?

Gordon:  Yeah, and you mentioned Open Data Hub earlier, and that's a good example of pulling all of this open source goodness really together, and trying to make it more consumable.

William:  I still think that the workflow tools, it's probably another area of the framework that needs to become more mainstream as well. Not just running AI ML workload, but the idea of being able to plan out the different layers in the workflow. I'm sure there's projects that I've lost track of in that area too. Probably in Data Hub.

That, plus the seamless console that allows you to see where data is coming from into the process. Instead of the gathering and the analytics being done on a, you know, "Let's gather, and now let's bring it over to this." If that workflow is streamlined too, where the gathering or the data is almost as CI/CD or DevOps y as the backend enterprise stuff is at the moment.

We have the applications in CI/CD but it's almost like we need to connect it all together from the data gathering. It's scary, but it's also that higher level view of it all into one pattern would be really useful.








Sunday, July 26, 2020

50 authors, 50 science fiction stories shorter than novels


I've been playing around with re-reading favorite science fiction short stories while also seeing if there's anything that has managed to elude me over the years. I've also tried to catch up with more recent authors given that I don't read as many books as I used to. (The market for science fiction short stories, in general, is in something of a decline but there are still some fabulous recent stories out there.)

A few rules I set for myself:
  • One story per author. Certainly there are many on this list for whom I could effortlessly reel off multiple deserving entries. A side effect of this rule is that it brought a fair bit of organic diversity to the list which would otherwise have been more heavily populated by a handful of favorite authors.
  • Nothing is novel length but you'll find plenty of novelettes and novellas alongside the short stories. (But I've tried to favor shorter works all other things being equal.)
  • I also didn't include authors whose novels I enjoy but just don't have any short stories I'm aware of that wowed me. 
  • Everything here can be plausibly categorized as science fiction although some hew far closer to traditional sf tropes than others that are at least adjacent to horror, fantasy, and philosophical fiction.
I used various lists and recommendations to tickle my memory and to ferret out works I might not be familiar with. But I've read everything here and don't think I've included anything just because it's "expected." These are personal favorites, or at least a coin flip among favorite stories by a given author. I did aim for some overall variety of time period, style, and subject matter but I think anything here can be enjoyed by a modern reader without making too many allowances.

Many of these stories can be found online and others in popular "best of" collections.

Anyway, my initial list (sorted chronologically) is below. While it's one story per author I do include pointers to other works in the comments. I've been careful to err on the side of avoiding spoilers but if you want to go into the stories completely cold, by all means, just work from this list of titles and authors.

"A Dream of Armageddon" H. G. Wells (1901)

This story comes from prolific Victorian writer Herbert George Wells. Wells wrote in a variety of genres including social commentary and history. However, he's most remembered for his science fiction novels like War of the Worlds (which was famously made into a radio play as well as films of varying levels of quality). This story used the fictional device of a man recounting dreams of a future time in which he is a political figure who has withdrawn from life to live with a younger woman on the island of Capri, even though this withdrawal is enabling opponents to start a great war with futuristic aircraft. Wells would later build on the concept for his novel The Shape of Things to Come which would itself serve as the loose basis for a film of the same name in 1936.

"With the Night Mail" Rudyard Kipling (1905)

Rudyard Kipling would win the Nobel Prize in Literature a couple years after this story was published. Unlike Wells, Kipling is not remembered for science fiction; rather he's mostly associated with stories and poetry often set in colonial India, where he was born and lived much of his early life. "With the Night Mail" is one of only two science fiction stories that Kipling wrote. Both concern the workings and activities of The Aerial Board of Control, a 21st century fictional organization that manages the dirigible and other air traffic for the whole world and acts as a de facto world government. 

"The Machine Stops" E. M. Forster (1909)

Rounding out this trio of Victorian English authors, Forster's reputation also comes in part from a novel, A Passage to India, that concerns the relationship between East and West as seen through the lens of India in the latter days of the British Raj--as well as other novels that primarily focused on class differences in England. However, Forster wrote that "'The Machine Stops' is a reaction to one of the earlier heavens of H. G. Wells." [The Eloi of The Time Machine.] In this novella, humanity lives underground and relies on a giant machine to provide its needs. There are technologies similar to video conferencing and the Internet. But the machine begins to fail and no one remembers how to fix it. This story is widely considered to be one of the most prescient short works of early science fiction.

"At the Mountains of Madness" H.P. Lovecraft (1936)

H.P. Lovecraft's primary reputation is as a horror writer. However, his stories that were part of the Cthulhu Mythos (such as this one) borrow premises often associated with science fiction such as alien invasion, other dimensions, and interference with human cultural and physiological evolution. For example, this novella popularized ancient astronaut theories as it details the events of a disastrous expedition to the Antarctic continent and what was found there by a group of explorers led by the narrator, Dr. William Dyer of Miskatonic University. 

"Microcosmic God" Theodore Sturgeon (1941)

Originally published in the magazine Astounding Science Fiction, this story is an early example of the use of the 'pocket universe' concept in science fiction. A biochemist develops a synthetic life form which lives (and invents) far more quickly than humans can. This biochemist, Kidder, is their "god" who exerts his power over them and profits from them. Sturgeon is not generally very well known but this particular story regularly and deservedly appears in collections and best of lists.

"The Library of Babel" Jorge Luis Borges (1941)

This short story, originally written in Spanish by Argentine author and librarian Jorge Luis Borges, is  more of a philosophical exploration than a science fiction story in the usual sense. It asks you to imagine a library whose books contain every possible combination of letters and numbers. Every great work is there, the account of your death is there, every possible scientific discovery that can be written down exists in the library. But any true information would be buried in, and rendered indistinguishable from, all possible forms of false information and complete gibberish. 

"The Weapon Shop" A. E. van Vogt (1942)

This story was developed from a much shorter 1941 story, "The Seesaw." It was, in turn, used as the basis for a portion of the 1951 fix-up novel The Weapon Shops of Isher. Another closely related novel published during the same period was The Weapon Makers. These books revolve around the immortal Robert Hedrock who once created the Weapon Shops as a force to counteract the imperial world government long dominant on earth. These two novels bring together van Vogt's style of hard science fiction and transcendent superheroes more than his other books. However, this short story may do an even better job on its own.

"Mimsy were the Borogoves" Lewis Padgett (1943)

Padgett was the pseudonym of spouses Henry Kuttner and C. L. Moore when they were writing together, often to humorous effect. This story title was inspired by a verse from “Jabberwocky,” a poem found in the classic novel Through the Looking-Glass by Lewis Carroll. It imagines mysterious educative toys timeslipped in from the future, which leads to the children discovering them to start thinking in new patterns and communicating in strange ways. "Twonky" and "The Time Locker" are other Padgett stories for which they're often remembered.

"Arena" Frederic Brown (1944)

Brown, who also wrote detective fiction, was noted for stories that were written with, what The Encyclopedia of Science Fiction calls "professional economies of effect." This short story is one of those. It tells of the settling of an interstellar war through single combat between a human and an alien. Either the story name or the plot summary may seem familiar to Star Trek fans; it was a popular episode during the first season of the classic series. Brown experimented with narrative styles. "The Sentry" is a micro-short which may seem more predictable today than when it was written. 

"A Logic Named Joe" Murray Leinster (1946)

This story, originally published under Leinster's real name (William F. Jenkins) contains an early description of a computer (called a "logic") in fiction. In the story, he imagined the Internet in many respects. He envisioned logics in every home, linked through a distributed system of servers (called "tanks"), to provide communications, entertainment, data access, and commerce; one character says that "logics are civilization."

"The Lottery" Shirley Jackson (1948)

Jackson was known for writing mystery and horror and this story strays as far as any on this list from what's usually considered science fiction. (This story was published in The New Yorker and few of her short works were in traditional science fiction magazines.) "Lottery in June, corn be heavy soon." To say much more is to probably give too much about this powerful short story away. To quote Martin Cahill: "If you asked anyone about a American short story that stuck with them for their entire lives, it would not shock me if they were to think for a moment, and then say, “that one story, ‘The Lottery,’” followed up with some form of, “that shit is fucked up.” Many of her best stories appear in the collection The Lottery and Other Stories.

"The Little Black Bag" C. M. Kornbluth (1950)

One might say that this story shares a similar premise with "Mimsy were the Borogoves" in that an object, in this case, a doctor's little black bag, gets sent back in time. However, suffice it to say that this is not an equally playful story. Kornbluth's classic works are this story and its sequel "The Marching Morons." However, he was a prolific author and his other works include "Two Dooms" which is considered to be one of the better What if the Nazis Won WWII treatments.

"There Will Come Soft Rains" Ray Bradbury (1950)

Bradbury's work has a poetic and evocative style that can tend towards fantasy and horror as much as science fiction. Charlie Jane Anders, who appears later on this list, had this to say about this particular story: "But this one, in which basically a smart house keeps going after its human inhabitants are all dead, is in a special league in the knife-twisting sweepstakes. Like a lot of stories in the years following World War II, it's concerned with the threat of nuclear annihilation, but also with how our technology might outlive us." This story appears in The Martian Chronicles, which is Bradbury's greatest work and you should just read the whole thing even if you're not a particular Bradbury enthusiast. But if you're looking for a single more Martian-themed story in that collection of linked stories, give "The Third Expedition" a try.

"Surface Tension" James Blish (1952)

During the 1950s, Blish wrote his Okie stories which envision a time when earthbound cities take to migrant wandering among the stars. Epic in scope, these stories were eventually wrangled into a single volume, Cities in Flight. During the same period, he was writing short stories of which "Surface Tension" is my favorite. The story concerns the events that follow after a spaceship crew genetically engineering their descendants into something that can survive after the ship crashlanded on a planet with only puddles of water. The miniaturized descendants must overcome surface tension if they're to get beyond their single puddle. Other well-regarded Blish short stories include "Common Time."

"It's a Good Life" Jerome Bixby (1953)

This story, more horror than science fiction, was the basis of a particularly good episode of the original Twilight Zone; it also has led to various remakes and riffs that played off of the idea including an episode of The Simpsons. At the center of the story is Anthony Fremont, a three-year-old boy with near-godlike powers; he can transform other people or objects into anything he wishes, think new things into being, teleport himself and others where he wants, read the minds of people and animals, and even revive the dead. As Anthony can read minds, the town's population must not only act content with the situation when near him, but also think they are happy at all times. 

"Fondly Fahrenheit" Alfred Bester (1954)

This is a breathless story of a man and his android whose personalities intermesh to become two aspects of a single insane murderous personality. Author Robert Silverberg has described it as a "paragon of story construction and exuberant style" which is what really makes it stand out on this exalted list. Other Bester short stories of particular note are "Adam and No Eve" and "The Men Who Murdered Mohammed."

"The Star" Arthur C. Clarke (1955)

Now we get into tough and at least somewhat arbitrary choices. Clarke is one of the authors on this list--two others, Asimov and Heinlein, are coming up shortly--who produced such an astonishing volume of quality short stories that picking just one is really impossible. But here we are. I give "The Star" the nod because there's deeper emotion than in much of Clarke's work. It's hard to say too much about this story without giving things away. Let's just say it concerns an expedition that has discovered the remnants of an advanced civilization destroyed when its star went supernova. Other favorite Clarke shorts include "The Nine Billion Names of God," "The Wall of Darkness," "Rescue Party," and "Meeting with Medusa." I might also throw in "The Sentinel" but mostly because it was the inspiration for the film 2001: A Space Odyssey.

"Fiat Homo" Walter M. Miller Jr. (1955)

This one is a bit of a cheat. In the early 1950s, Miller published a series of short stories which would shortly be combined and reworked into A Canticle for Leibowitiz, his only novel and the work for which he is known. A Canticle for Leibowitz is arguably the best post-apocalyptic work of science fiction and differs significantly from the more common "Mad Max" model. The novel is set in a sort of Dark Ages hundreds of years after the holocaust and tells its story from the point of view of monks preserving knowledge as in the previous Dark Ages. The reworked "Fiat Homo" makes up the first part of Canticle and is arguably the strongest but, in practice, it's the full novel that you'll read. 

"Time in Advance" William Tenn (1956)

While not especially well-known (he never won a science fiction writing award), Tenn, the pseudonym of Philip Klass, wrote sharp-witted stories, often with a darkly comic side. This story, written fairly near the end of his active writing career, is set in a far future where a law has been passed enabling citizens to serve out sentences for crimes they intend to commit, serving the full term, but with a 50% pre-criminal discount. When two such pre-criminals return to earth intending to carry out the crimes they've earned, things don't go as planned. "The Brooklyn Project" is another story well-worth your time and was pretty much a toss-up with this one.

"The Last Question" Isaac Asimov (1956)

Asimov himself suggested that this was one of his favorite short stories. "I got the idea all at once and didn't have to fiddle with it; and I wrote it in white-heat and scarcely had to change a word. This sort of thing endears any story to any writer," he once wrote. It really is almost a perfect idea-based science fiction short story. It deals with the development of a series of computers called Multivac and their relationships with humanity through the courses of seven historic settings, beginning on the day in 2061 when Earth becomes a planetary civilization. In each of the first six scenes a different character presents the computer with the same question; namely, how the threat to human existence posed by the heat death of the universe can be averted. it's tight, it's funny, and it's got a killer ending. His original novella "Nightfall" is also wonderful but I think this short story gets the nod. One or more of his Robot stories could make their way onto this list as well but I think of them as more of a group achievement award than individual standouts.

"All You Zombies" Robert Heinlein (1959)

This story involves time travel paradoxes and further explores themes introduced in Heinlein's earlier "By His Bootstraps." In his analysis of the story, Davi Ramos writes that "Individualism and the free expression of love and sexuality are among its main themes. The work analyzed here pushes the boundaries of causality to mind-bending extremes, in order to discuss the boundaries of sexuality and the logic of identity." The narrative flow is complex and you probably won't totally get it on your own the first time around. The film Predestination is based on this story. Some other short stories I'd put on the list are "The Unpleasant Profession of Jonathan Hoag" and many of the stories collected in The Past Through Tomorrow future history including "Requiem" and the prequel to his Lazarus Long immortality saga Time Enough for Love, "Methuselah's Children."

"Flowers for Algernon" Daniel Keyes (1959)

Algernon is a laboratory mouse who has undergone surgery to increase his intelligence. The story is told by a series of progress reports written by Charlie Gordon, the first human subject for the surgery, and it touches on ethical and moral themes such as the treatment of the mentally disabled. The short story was later expanded into a novel and made into the film Charly (for which Cliff Robertson won the Oscar for Best Actor) and many other adaptations but I think the original story is still the most effective. 

"Chronopolis" J. G. Ballard (1960)

Ballard probably became best known (whether people knew his name or not) for his war novel, Empire of the Sun, a semi-autobiographical account of a young British boy's experiences in Shanghai during Japanese occupation--which Stephen Spielberg later made into a film. But he also had a career as a science fiction author which spanned the "world destroying" genre (The Drowned World, The Wind from Nowhere) like other British authors such as John Wyndham to experimental efforts some of which were adapted into films like  David Cronenberg's Crash. However, he also wrote some enticing short stories. One of them is "Chronopolis" which begins with a man in prison, Newman, and proceeds to examine his fascination with the concept of time in a world where clocks have been prohibited and are regulated by time police. Other Ballard shorts that aren't too experimental include "The Drowned Giant, The Overloaded Man," and especially "Thirteen for Centaurus."


"The Lady Who Sailed the Soul" Cordwainer Smith (1960)

The nom de plume of Paul Myron Anthony Linebarger, Smith (not to be confused with E. E. Doc Smith of Lensman fame) wrote relatively little, in part because he held jobs that required extensive foreign travel. Most of his science fiction was in the Instrumentality Universe and author Frederik Pohl described his stories as "a wonderful and inimitable blend of a strange, raucous poetry and a detailed technological scene, we begin to read of human beings in worlds so far from our own in space in time that they were no longer quite Earth." This story is one of his more lyrical works. It's adjacent in timeline to "Scanners Live in Vain" which is another Smith story written ten years earlier near the beginning of his science fiction writing. While Scanners is often cited as Smith's best work, I find its older provenance gives it a more archaic feel.  

"Harrison Bergeron" Kurt Vonnegut Jr. (1961)

Although Vonnegut was a mainstream author, whatever that means exactly, many of his novels contained fantastical or science fictional elements whether the Ice Nine of Cat's Cradle, the time displacement of Slaughterhouse Five, or just about anything related to The Sirens of Titan. The premise of this story is that amendments to the Constitution dictate that all Americans are fully equal and not allowed to be smarter, better-looking, or more physically able than anyone else. The Handicapper General's agents enforce the equality laws, forcing citizens to wear "handicaps" such as masks for those who are too beautiful, loud radios that disrupt thoughts inside the ears of intelligent people, and heavy weights for the strong or athletic.

"A Rose for Ecclesiastes" Roger Zelazny (1963)

This is another one of those stories that the reader is probably best discovering on their own. It involves the Biblical book of Ecclesiastes, language, Mars, and prophesy and we should probably leave it at that. This story was an early career work for Zelazny who would go on to write many novels, most notably Lord of Light and his Amber series.

"'Repent, Harlequin!' Said the Ticktockman" Harlan Ellison (1965)

I had the pleasure of seeing Ellison speak a couple of times when I was an undergrad and he was simultaneously both entertaining and thought-provoking. If I'm being honest though, I've tended to admire rather than love many of his short stories. That said, "'Repent, Harlequin!' Said the Ticktockman" opens with a passage from Civil Disobedience by Henry David Thoreau. The story is a satirical look at a dystopian future in which time is strictly regulated and everyone must do everything according to an extremely precise time schedule. And breaking the law has severe consequences. Another perpetual Ellison favorite is "I Have No Mouth, and I Must Scream."

"Light of Other Days" Bob Shaw (1966)

With Shaw we return to a writer, who in spite of a body of work, is mostly known for a single story and, to a lesser degree, its sequel "Burden of Proof" and an associated novel, Other Days, Other Eyes. The melancholy "Light of Other Days" builds on the idea of "slow glass," glass through which light takes years to pass, to explore the preservation of the past into the present.

"We Can Remember it for you Wholesale" Philip K. Dick (1966)

Dick's fiction explored varied philosophical and social themes, and featured recurrent elements such as alternate realities, simulacra, monopolistic corporations, drug abuse, authoritarian governments, and altered states of consciousness. He was prolific but a number of his works were arguably more successful as screen adaptations than in their original print form. This story about memory implants and the nature of reality stands well by itself but also was the basis for the 1990 film Total Recall directed by Paul Verhoeven and starring Arnold Schwarzenegger--which is probably best interpreted in light of its original source material. 

"Neutron Star" Larry Niven 1(966)

Niven is best known for his hard-science Known Space series populated by imaginatively-drawn strange aliens and exotic technologies in a far-future. This story is the first to feature Beowulf Shaeffer, the ex-pilot and reluctant hero of many stories. It also marked the first appearance of the nearly indestructible General Products starship hull, as well as its creators, the Pierson's Puppeteers, a cowardly but advanced race that have an appearance somewhat in common with centaurs. Shaeffer's mission is to explore a neutron star and things go wrong; it turns out the science in the story in the story isn't quite right but it's still a great example of Niven's work. Niven's shorts tend to be stronger than his solo-authored novels. Many of the stories in the known space series are good reads, including those in the collection named after this story, Neutron Star. Outside the Known Space universe, "Inconstant Moon" is a great read and arguably his best if just picking stories in isolation.

"Aye, and Gomorrah" Samuel Delany (1967)

This first appeared as the final story in Harlan Ellison's seminal 1967 anthology, Dangerous Visions. It was controversial because of its disturbing sexual subject matter although, like many of the stories in that anthology, stories that pushed the envelope in 1967 don't necessarily do so today. The narrative involves a world where astronauts, known as Spacers, are neutered before puberty to avoid the effects of space radiation on gametes. Aside from making them sterile, the neutering also prevents puberty from occurring and results in androgynous adults whose birth-sex is unclear to others. Spacers are fetishized by a subculture of "frelks" attracted by the Spacers' lack of arrousability.

"The Ones Who Walk Away from Omelas" Ursula Le Guin (1973)

Le Guin wrote over a course of almost 60 years to a variety of audiences in a variety of genres. This story is essentially philosophical fiction that explores a summer festival in the utopian city of Omelas, whose prosperity depends on the perpetual misery of a single child. Another, longer, Le Guin story "Buffalo Gals, Won't You Come Out Tonight" recounts a human girl's meeting with incarnations of Native American spirit animals and appears in an eponymous collection.

"Where Late the Sweet Birds Sang" Kate Wilhelm (1974)

This story is the first of three linked stories later published as a novel of the same name in 1976. It takes  place as civilization is collapsing; an isolated group prepares for this largely infertile post-collapse world by undertaking a cloning program. Wilhelm wrote novels and stories in the science fiction, mystery, and suspense genres over the course of a long career. One other story especially worth checking out is "The Girl Who Fell into the Sky," which is more supernatural than SF but did win a Nebula for best novelette.

"Houston, Houston, Do You Read" James Tiptree Jr. (1976)

This novella is another one of those stories where just about any description would shortchange readers wanting to experience it without knowing what it's really about and where it's headed. Tiptree was the pen name used by Alice Bradley Sheldon from 1967; her real identity wasn't widely-known but was generally assumed to be that of a man until it leaked out shortly after this story was written. However, there was speculation, based partially on the themes in her stories (including this one), that Tiptree might be female. In any case, this is an interesting story that won both Hugo and Nebula prizes, even if the gender and social stereotypes seem dated for the time it was written.

"Ender's Game" Orson Scott Card (1977)

This story gave birth to a series of novels, starting with a novelization of "Ender's Game" and leading to a series of increasingly undistinguished novels. While the first sequel, Speaker for the Dead, was quite excellent in its own right the initial short story shines brightest in my opinion. This story begins as Ender is made the commander of Dragon Army at Battle School, an institution designed to make young children into military commanders against an unspecified enemy. Armies are groups of students that fight mock battles in the null gravity Battle Room. Due to Ender's genius in leadership, Dragon Army dominates the competition. Go ahead and read the story.

"The Guy with the Eyes" Spider Robinson (1977)

In general, I've tried to pick standalone stories for this list. This one works fine in that vein but it's really here as the first entry in the linked stories that make up Callahan's Crosstime Saloon stories; they've been collected into a number of books beginning with Callahan's Crosstime Saloon. The stories are filled with strange or unusual events and visitors and are an obvious homage to Fletcher Pratt and L. Sprague de Camp's Tales from Gavagan's Bar and Arthur C. Clarke's Tales from the White Hart.

"Sandkings" George R. R. Martin (1979)

Martin is, of course, best known for his series of epic fantasy novels A Song of Ice and Fire, which were adapted into the HBO series Game of Thrones. However, before this breakout, he had earlier written a variety of stories that mixed fantasy, horror, and science fiction of which "Sandkings" is a clear example. It certainly includes sensibilities that will be familiar to Game of Thrones viewers. Suffice it to say that Martin was supposedly inspired by a college friend at Northwestern University who had a piranha tank and would sometimes throw goldfish into it between horror film screenings. (This explains a great deal about Martin.)

"The Gernsback Continuum" William Gibson (1981)

This is probably an unconventional choice. "Burning Chrome" or "Johnny Mnemonic," associated with his Sprawl trilogy, would probably be more more conventional picks for Gibson short stories. But I think this story is actually more central to cyberpunk. As Bruce Sterling writes "'The Gernsback Continuum' shows [Gibson] consciously drawing a bead on the shambling figure of the SF tradition. It's a devastating refutation of 'scientifiction' in its guise as narrow technolatry." It takes down the glimmering science fictional cities in which zeppelins rule the airways.

"True Names" Vernor Vinge (1981)

This novella doesn't have the gritty ambiance but it's still a seminal work of the cyberpunk genre. In 2001, The New York Times declared that Vinge's depiction of "a world rife with pseudonymous characters and other elements of online life that now seem almost ho-hum" had been "prophetic." I'd add that the idea of a true name, which is to say the tying of someone's online identity to their identity in the real world, doesn't utilize Vinge's term as much as it should. He subsequently wrote novels that explored a future libertarian society and the impact of a technology which can create impenetrable force fields called 'bobbles' but is probably best known for his 1992 novel A Fire Upon the Deep and, to a lesser degree, its sequels. A newer story that deals with a similar topic updated is "Fast Times at Fairmont High," which can be viewed as a sort of pilot for his Rainbows End.

"The River Styx Runs Upstream" Dan Simmons (1982)

Although his Hyperion Cantos series of (primarily) novels are science fiction, much of Simmons' output is horror and this story certainly bridges both genres. This was the story Simmons published after attracting the attention of Harlan Ellison at a writing workshop. The story imagines a world in which "Resurrectionists" can technologically revive family members but, while they can then function somewhat autonomously, they no longer have higher brain functions. Many of Simmons' short stories are in the collection Prayers to Broken Stones, which also includes "Remembering Siri," originally a part of the aforementioned Hyperion

"Bloodchild" Octavia Butler (1984)

Set on an alien planet, this story depicts the complex relationship between human refugees and the non-humanoid aliens who keep them in a preserve to protect them. Themes of co-existence and breeding appear throughout much of Butler's writing, including the Xenogenesis trilogy that came out during the five years following this story.

"The Crystal Spheres" David Brin (1984)

The Fermi paradox, named after physicist Enrico Fermi, refers to the apparent contradiction between the lack of evidence for extraterrestrial civilizations and the many estimates that suggest such civilizations should be commonplace in a very large and old galaxy and universe. This story postulates a solution, the starting point of which is that every habitable solar system is surrounded by a "crystal sphere" which can only be broken from the inside--once a civilization has the technology to do so. Another good Brin short story is "The Giving Plague" but I figured there were already enough stories with a plague component on this list given the times.

"Schrödinger's Kitten" George Alec Effinger (1988)

Partially sharing the same setting as a number of his novels, this novelette follows a Middle-Eastern woman, Jehan Fatima Ashûfi, through various realities. She perceives these realities as "visions" and assumes they might come to her from Allah. The realities correspond to a form of the many worlds interpretation of quantum mechanics, and the story's title comes from the Schrödinger's cat thought experiment.

"Axiomatic" Greg Egan (1990)

In this story, which appears in a collection of the same name, the protagonist enters a store selling mods not only for every variety of psychedelic experiences, but for altering one's personality traits, sexual orientation, and even religion. The protagonist seeks a custom-made mod that will suspend his moral convictions long enough for him to murder his wife's killer. All the stories in the collection delve into different aspects of self and identity.

"Even the Queen" Connie Willis (1992)

This short story falls squarely on the comic side of Willis' production. The Village Voice called it "a comedy of identity politics and mother-daughter relations" and it's as good an introduction as any to Willis' light-hearted and sometimes madcap writing. She also has a more more somber, even tragic, side with stories such as "The Last of the Winnebagos" and "A Letter from the Clearys." "Fire Watch" is a short story introduction to her works that feature time travel by history students and faculty of a future University of Oxford; noteworthy novels in that series are Doomsday Book and the To Say Nothing of the Dog.

"Story of your Life" Ted Chiang (1998)

Although the decline of science fiction magazines has arguably helped lead to a decline of shorter science fiction overall, the well-awarded Chiang has never written a full-length novel. Moviegoers may recognize this novella as the basis for the 2016 film Arrival. (The film keeps the basic structure of the story but adds what are probably best described as Hollywood elements.) The story is narrated by linguist Dr. Louise Banks who is called in to communicate with alien visitors. It brings in questions of free will and the nature of time but it's another story that rewards discovering its structure on your own. Chiang has many fine works but another particularly noteworthy novella is "The Lifecycle of Software Objects."

"The Janitor on Mars" Martin Amis (1998)

Amis is a British writer who has published very little science fiction; indeed this story, which was originally published in The New Yorker, is the only science fiction in the Heavy Water and Other Stories collection where it appears. In this story, a robot makes contact from Mars and reveals the  truth of mankind's place in the Universe. It's funny and sad at the same time. 

"The Fermi Paradox is our Business Model" Charlie Jane Anders (2010)

This story is a fun take on why the previously mentioned Fermi Paradox might be the result of deliberate outside actions. Aliens may be involved. And they may not be benevolent. Anders has also won a Hugo for her novelette "Six Months, Three Days."

"Sinners, Saints, Dragons, and Haints in the City Beneath the Still Waters" N. K. Jemisin (2010)

Much of Jemisin's writing concerns cultural conflict and oppression. This story is set in the Ninth Ward of New Orleans in the aftermath of Hurricane Katrina. Heather Rose Jones writes that "What makes this story great is the immersive voice and language, the way descriptions of everyday surroundings slide easily into the fantastic, and the way the folklore of cities and peoples is woven into a new mythos."

"Inventory" Carmen Maria Machado (2013)

This is yet another story about which I hesitate to say much of anything. It's more literary than genre and to even say why it's connected to science fiction would be to cheat the reader.

Some of the text in this post is adapted from Wikipedia and The Encyclopedia of Science Fiction by John Chute and Peter Nicholls.

Hacker News thread: https://news.ycombinator.com/item?id=23959648