The focus is no longer on how much of a full paper you can cram onto a limited space, but how rapidly you can deliver your central finding(s) to an audience of highly-distracted session attendees. Check out the Powerpoint templates as well - he’s included some suggestions on high-contrast color schemes and some other design details. I’ll definitely implement some of these ideas in my next poster.
It increasingly feels like the venerated Academic Poster has outlived its usefulness. It’s still a fixture at most conferences in virtually any field, and it makes sense, as the benefits are clear:
Posters are conceptually simple. They’re just like manuscripts, but bigger!
Posters don’t need to have a specific format. True, some consistency is nice, but elements and figures on a poster can take any size or shape, as long as they fit.
Posters are visual aids. Unlike formal talks, they don’t have a time limit. They exist to support discussion.
These are all also reasons why I feel posters are nearly obsolete. Posters (and, at this point, I’m really just talking about “big sheets of paper containing some kind of interesting information”) work best as a mechanism for fostering discussion, whether there’s a human being standing nearby or not. But what a manuscript does well in terms of information density, a poster does very poorly. No one wants to stand in front of a poster and absorb an entire research project’s worth of material when they could get the gist with a bit of visual assistance. If a manuscript is a buffet, a poster should be some light canapés. Maybe some nice hummus and pita chips.
(I’m not entirely sure that formal manuscripts really serve their purpose in conveying scientific findings anymore, either, but that’s an entirely different discussion, and likely a much more extensive one.)
I’ve been collecting some examples of alternative posters. Some are just visually interesting, while others entirely change the format. All of them play with the audience’s expectations. That seems like the best way to capture attention and foster discussion. I’m not going to call out any boring posters here as that wouldn’t be friendly or productive, but I’ve certainly produced a bunch of them before. They usually look like this:
Why do posters still look like this? Beyond trying to render them as tiny manuscripts, I suspect much of it has to do with the role of posters as media for trainees. In most fields, students and junior researchers predominantly present posters, while more senior folks give talks. This may mean the more junior folks just have more to prove. Their poster is as performative as it is informative. It has to convey how serious the involved people are about their area of study.
I don’t have a solution for this problem. It may involve rethinking why and how we convey new findings and resources. Can we separate the performance from the product?
Here are some of those alternative posters, anyway. All have been shared elsewhere or presented at large conferences. Some I found through the Better Posters blog. That blog is very relevant to this topic and is absolutely worth investigating further.
This one is by Gavin Abercrombie from the University of Manchester.
Natural language processing is hard to visualize since it’s mostly about text. This poster does a great job of visualizing a process without totally avoiding details.
Even without the texting motif, this is effective because it breaks an entire study down into a few basic questions and answers. A name probably would have been nice.
I saw this next poster at ISMB 2017 - it’s advertising the Debian Med Blend and its bioinformatics packages. Seems like a good strategy if the whole point is to market a set of resources rather than to prove how well a tool performs at a given function.
I’m still looking for more alternative poster formats, and even wholesale alternatives to posters. I’m not sure an ideal replacement exists yet. It’s possible there isn’t one, and it’s possible that there isn’t a formal presentation mechanism better at conveying scientific findings than an informal conversation already is.
August 22, 2013
Not really a note as much as a reminder. NowComment is a system for online collaborative discussion, or put more simply, it lets a bunch of people leave comments on a single document. Sounds a bit like a Google Doc, right? There’s certainly some similarity, in that documents can be commented on, but the annotations are the real focus here. The closest analogue may then be Genius, but with more flexibility in document content.
This could be a great way for manuscript authors to do collaborative edits without the unfortunate status quo of sending Word files back and forth. It could also work well for journal clubs. In theory, just upload a PDF and have everyone comment on the same document. In practice, I couldn’t get NowComment to accept an uploaded PDF (This one - https://wwwnc.cdc.gov/eid/article/24/11/pdfs/18-0381.pdf along with a few similarly formatted documents) without throwing an error and refusing. Disappointing, but there is a workaround: copy and paste the HTML version of the manuscript using NowComment’s copy n’ paste option. You get something like this and can highlight sentences or entire paragraphs. See below.
September 30, 2013
Has this been done already?
At the time, I was likely thinking of something like the following projects:
CVDazzle, essentially a small collection of fashionable attempts to evade face recognition. This is from 2010 and I bet modern computer vision approaches would have little issue with it.
The “ugliest shirt in the world”, a fictional garment used in William Gibson’s modern-day-cyberpunk novel Zero History to evade face detection and other visual security systems.
Shirts with faces on them - intentionally as a realization of the above concept. This is one set of examples designed by a graphic designer in Amsterdam; the pages for the designer’s original work don’t appear to be alive, but her landing site is here. The concept is very simple, though, and could extend to any shirt with a face on it.
These projects all start with the idea that omnipresent computer vision and facial recognition, whether live or after-the-fact through social network tags and such, is avoidable. It could be distracted in much the same way as a police dog may have its concentration broken by a nice, fresh steak. I think this concept treats the situation as an arms race at best: face recognition technology constantly improves, so even with more effective countermeasures, any attempt to hide is still just providing more data for the computer vision methods to work with. If there’s a face, they’ll find it, or they’ll certainly make an educated guess. A sufficiently advanced method may also notice attempts to conceal someone or something.
Evading face recognition continues to be an active subject in art and design. Maybe visual artists are best equipped to hide from face recognition due to their particular aesthetic pursuits. Here are some more recent projects:
Faceless. Re-inventing Privacy Through Subversive Media Strategies, a catalog of art exhibitions on the subject
The HyperFace pattern, by the designer of CVDazzle
If we’re going to treat this idea as something more than graphic design or fashion (not that there’s anything inherently wrong with those fields - I just think there are some interesting technical concepts here as well), we will need to define who may want to hide and what they may want to hide from. We need to do some threat modeling. How and where are we most likely to have our image captured? Who will be doing it? Will it be fully automated, or will there be a human involved? What are we hiding from, anyway?
We likely won’t be able to design a fully effective solution for hiding in every conceivable situation (at that point, we’re talking about an invisibility cloak, a subject of ongoing efforts from multiple groups) but we can address some of the above questions. The ubiquity of cell phone cameras suggests that most individuals in public places are likely to be photographed by personal devices much more often than by automated surveillance systems. Even in places like Beijing with their wide surveillance camera coverage, cameras are rarely at face level and are generally conspicuous in their placement. They can be partially avoided with simple solutions like hats, especially ones with a few LED modifications. Practically anyone with a phone can take direct, clear, surreptitious photos of your face, however, at which point face recognition algorithms like those used by Google and Facebook do the challenging identification work.
As for what we’re trying to avoid, let’s assume we simply don’t want our image to be used without our knowledge. Misrepresentation is all too easy: imagine a situation where you’re photographed walking out of a restaurant later determined by conspiracy theorists to be a hub of salacious activity. An ideal preventative measure will decrease your likelihood of being photographed while also making it more difficult for face recognition methods to identify you.
Surveillance is still a concern, but not one I believe will be easily addressed through garment-based means. For one thing, it seems likely that much of the visual data collected by authorities is kept until it’s useful. Images are collected and stored under the pretense that they’ll eventually be useful for the next generation of face recognition or because it’s supposedly too complicated to erase them. Face recognition using these data can have a staggeringly high false positive rate (interestingly, some police departments employ “super-recognizers” highly skilled at matching faces to photos, so they’re often better at their jobs than automated methods). It’s difficult to anticipate how to avoid a method which isn’t even working as intended, so unfortunately the best solution for avoiding surveillance systems may be to avoid public places and events. This strategy won’t help as much for avoiding personal cameras, for the reasons I’ve mentioned.
What can we do?
With a threat model involving human camera operators and their algorithmic accomplices, we can start to assemble a basic approach to evading both. Traditional camouflage works well for hiding from people, so we can work with its strengths while adapting them to the particulars of automated face recognition. Many of its strengths will apply to both humans and algorithmic approaches anyway.
Camouflage doesn’t make its wearers invisible, just harder to distinguish from their environment. This means we need to remain cognizant of the surroundings where our new patterns may be used. A universal solution is beyond our reach. Based on our threat model of “somebody with a cameraphone”, urban environments with crowds and direct lighting are most likely. We should also avoid pattern elements with noticeably different appearances from their surroundings, so the bar codes and QR codes and logos and such from my initial idea may not work well. They’re also too easy to identify by automated methods.
The concept of pareidolia may work well. It’s the tendency to see faces where there are none. Humans and face recognition systems are both susceptible to it. The HyperFace pattern linked above plays with this idea, and while it’s difficult to determine if it contributes much to evading face recognition (i.e., if a system sees many false faces near a real face, does it ignore them all?), it seems like a fine starting point.
Computer vision algorithms can be fooled outright. There’s a whole field of adversarial work exploring the cases where image classifiers mistake one type of image for another:
Google’s image classifiers can be fooled by 2D and 3D objects, often with seemingly bizarre results.
Sometimes one pixel is all it takes to fool a classifier.
These examples are contingent on special cases, potentially where the image data used to train an otherwise powerful and human-like neural network just doesn’t contain many examples of a given item, or that item looks kind of strange anyway. You can probably tell the difference between a photo of a cat and one of guacamole, but a close-up of the latter could look like all kinds of things. Let’s try it out:
The local environment remains important, too. Barack Obama’s face doesn’t just show up at crowds at random, nor do large globs of guacamole, unless there’s been a burrito accident. We can’t perfectly anticipate the local environment beyond what we’ve assumed already, nor can we know the perfect adversarial conditions at all times. Instead, we can attempt to create a pattern likely to produce incidental adversarial conditions. Or, essentially produce pareidolia for faces and all kinds of other shapes.
I think it’s crucial to note at this point that most face recognition methods are still terrible at recognizing faces unlike those in their training data (e.g., anyone who isn’t a white man). Obviously “change your sex and/or ethnicity” isn’t a good solution for addressing how well a system may or may not recognize you, especially if the underlying system is already being employed in a biased way (and more or less every system is, so feel free to argue with me about that). This may just be additional evidence that ubiquitous photography and face recognition are to be avoided on the grounds of personal safety.
I believe a new camouflage pattern should be designed with a threefold strategy:
Overwhelm - not just by repeating easily detected patterns, but by using strange combinations and adversarial design
Obfuscate - combine the properties of traditional camo patterns with patterns automated methods have difficulty with due to limitations in their training data
Overlay - accentuate details that are likely to look like the surrounding space, or at least don’t differ from nearby patterns noticeably (again, much like traditional camo)
Accordingly, I’ll name this project camOOO, after those three O’s. It should be pronounced like cam-oooh, or like Albert Camus.
What can we start with?
Here are a few visual starters:
Camopedia, the perfect resource for this kind of thing.
One of the patterns I’d suspect image classifiers would have the most trouble with is the Polish wz. 68 “moro”. It looks like a rainy puddle reflecting some variety of exotic predatory cat. Or, like this:
Google’s Cloud Vision tools aren’t immediately fooled:
For comparison, here’s some modern digital camouflage:
The results are fairly obvious - this looks like camouflage. It’s probably widely recognizable to people, too.
What I’d like to start with, then, is a way to generate that Polish pattern in a variety of muted greys and greens. The famous Disney “go away green” is a good color philosophy.
Is it time to build something yet?
Here’s what I want a pattern to incorporate:
A background camo texture, colored blandly but contrastingly
Details more like an urban environment
Potentially adversarial content
Almost obvious matches from training data, chosen at random, and overlapping with Step 2
Ideally I will create and combine these elements in a generative manner. Processing seems like a good set of tools for approaching this set of requirements.
Also potentially of use:
Progress so far
Here’s what I have thus far - it doesn’t look like much, but it’s largely generative rather than just a bunch of bitmaps glued together. More code details later once things have congealed.
Needs more faces, I think, or maybe animals, without getting too DeepDream-y.
Oops, too much!
December 6, 2013
Most randomly-generated numbers are, in fact, the results of pseudorandom processes. This is because it's fundamentally easier to generate random numbers with purely deterministic, software-defined methods, plus these methods are conceptually simple to replicate. Given the same input (a random seed), the pseudorandom number generator will provide the same output. So when the output absolutely has to be random (or, at least, far more difficult to replicate), random numbers are generated based on stochastic processes in nature. There are dedicated hardware products, Geiger counter-driven approaches, and fancy quantum methods for the task. There was also Lavarand, a random number generator based on a camera pointed at a lava lamp. It was such an effective method that it's still in use by multi-purpose internet company Cloudflare. I think it's more fun to observe other features of the world around us.
I suggest using kittens. A random number generator should depend upon a rapidly-changing, generally unpredictable (within the bounds of our measurement, at least) but otherwise consistently occurring phenomenon. Kittens are consistently popular, to the point that it's nearly an inarguable law of nature. Given the right measurement, we can take advantage of stochasticity in this process to produce random values.
In truth, this is likely a terrible idea and would never be suitable for any security purposes. Using news sources alone also creates some limitations, so in order to make this more fun while still disavowing any suitability for real-world applications whatsoever, we could use results from social media instead. This will have to be a project for a different day. For now, something like quantumrandom will provide true random numbers, though without all the kitten counting.