intelligence analysis, overcoming bias and learning

All Source Analysts Training

After a recent DGS DART working group my office was having a discussion on all source analysts training. There seems to be some misconception at least in the DGS community as to what training should be required for those Analysts who are working in an All Source capacity. I think part of this stems from the fact that the AF does not have an All Source Analyst AFSC. Each AFSC traditionally has been INT focused with the exception on the 1N0s, who are Ops focused assigned generally to flying squadrons and the 14N Intelligence Officer.

The line of thinking at the working group tended to steer towards mission specific training and application training rather than core skills that could be used at any unit.

I wanted to get everyone’s thoughts on some of the basic skills training that any all source analysts should have in the toolkit.

The idea we have come up with is a three track approach for all source training, regional training and mission specific training.

The All Source track would be a pyramid with courses built on a foundation of basic skills.

Foundation Skills
• Analytical Methods
– Problem definition
– Process (scientific method)
– Statistics
• Research
– Strategies
– Source evaluation
• Communications
– Technical and Editorial Writing
– Briefing
101 Training
• AFSC/MOS Technical School
– 1NX
• By-fire hose training
– 1N1: Receives SIGINT, HUMINT, AGI, OSINT
– Intel: Receives Ops familiarization;
– AF: Rcvs Army-centric, Navy-centric, Joint
• Military Capabilities
• General Intelligence (CIA, NSA, NGA, etc)

Advanced Skills
• Scenario-based training/exercises
• Specialized analytical techniques
– HUMINT-specific support
– MASINT-specific support
• Region-centric integration
– Able to correlate language, geo-political, and cultural aspects to specific intelligence problems

This from MERX, Canada's public tender posting page (bolding mine):
"....Defence Research & Development Canada (DRDC) have a requirement to retain the services of a contractor to provide support for DRDC Toronto's data collection and collection involving a series of behavioural science experiments with human subjects. The experiments described in this Statement of Work (SOW) are motivated by DRDC Toronto's Applied Research Program (ARP) project, entitled "Understanding and Augmenting Human Capabilities for Intelligence Production," which is under the project management of Dr. David R. Mandel, Group Leader of the Thinking, Risk, and Intelligence Group within DRDC Toronto's Adversarial Intent Section. The overarching objectives of the ARP project and the experiments described herein for which contractor support is sought are: (a) to identify systematic biases in human performance that may effect the quality of intelligence analysis; (b) to identify factors that may attenuate or amplify such biases or otherwise influence judgmental performance; and (c) to examine the viability of counter-measures aimed at reducing or eliminating them...."

More details in Statement of Work here (.pdf download).

With some slight experience as one of them and with Analysts, I noted the problem, acknowledge that many can park their bias and do an effective job (subject and issue dependent) but am firmly convinced it is a problem. glad to see someone delving into it. Look forward to the result.

What about the bias of the people conducting the research? Is there another panel to investigate their possible bias?

While there's been some discussion of this in American intelligence circles, I haven't seen any definitive counter-measures. For example, there was no method for us to challenge the bizarre analysis of a battalion S-2 (so-called battalion senior intelligence analyst) who proclaimed that the main problem in our province was "criminal activity" and not the Taliban. We figured that since this conclusion wasn't based on any actual reporting, she must have some kind of cognitive bias against, say, reality.

Quote:

---

Originally Posted by IntelTrooper

For example, there was no method for us to challenge the bizarre analysis of a battalion S-2 (so-called battalion senior intelligence analyst) who proclaimed that the main problem in our province was "criminal activity" and not the Taliban. We figured that since this conclusion wasn't based on any actual reporting, she must have some kind of cognitive bias against, say, reality.

---

No, no, no! It's not a bias against reality, it's a definition of the Taliban as criminals :cool:!

Now, it would have been a bias against reality if she had defined the Taliban as Smurfs... then again, maybe not :eek:!
http://bosey.co.in/archive/014/IMAGES/smurf.jpg

It also is a significant aid to keeping everyone honest...

The Canadians know that and are smart enough to have someone else also take a look and pull best ideas from both. We, on the other hand...

The efficiencies of consolidation and centralization are known, what is often ignored is the adverse impact of those moves on effectiveness. Two minds / approaches are always better than one; three even mo' betta... ;)

There's another aspect aside from effectiveness. Put another way, you can always have your best gunners do the shooting or the best guy on point -- but no one else will learn much or become good at what they do and your bench will not be very deep.

All that has been known for centuries; "Quis custodiet ipsos custodes?" is not new and is practiced in most of the world; only the insane American predilections for one size fits all, one size does all, "whatever the boss wants" and "always show your good side" ignore that logic.

You're not likely to see any US countermeasures. We prefer those who totally support what the Boss wants, no matter how inane or even criminal -- as your example proves... :mad:

Quote:

---

Originally Posted by marct

No, no, no! It's not a bias against reality, it's a definition of the Taliban as criminals :cool:!

---

Curses, now I'm the one with the bias...

Quote:

---

Now, it would have been a bias against reality if she had defined the Taliban as Smurfs... then again, maybe not :eek:!
http://bosey.co.in/archive/014/IMAGES/smurf.jpg

---

I thought I recognized the guy in those briefings! Mullah Papa Smurf AKA Abu Smurfette...

Quote:

---

Originally Posted by Ken White

You're not likely to see any US countermeasures. We prefer those who totally support what the Boss wants, no matter how inane or even criminal -- as your example proves... :mad:

---

Yes we do... as I had the distinct impression that her "analysis" was thinly-disguised propaganda to make her battalion commander look good...

Quote:

---

Originally Posted by Ken White

The Canadians know that and are smart enough to have someone else also take a look and pull best ideas from both. We, on the other hand...

---

We have some absolutely top-notch analysts—and, obviously, some less so. HOWEVER, one disadvantage of having a very small community is... that we have a very small community. Consequently, there is less opportunity for exchanging ideas/debating/challenging assumptions/etc. Virtually all of the folks that work on the Middle East, for example, could comfortably fit into the Sparks Street Tim Hortons for a double-double.

There are ways of offsetting that, of course--for example, by bringing folks into discussions who aren't in the IC, but rather in the aid, diplomatic, or even (heaven forbid) the academic and NGO communities. Some agencies and managers do it. Some don't. It is obviously harder in MI (especially on the deployed, pointy end) than it is in political assessment however, and the folks in the LE and security intelligence communities aren't always used to working that way either.

There's also interchange with allied communities, and especially the US, not just at the level of data but also in terms of conferences/meetings/discussions/etc.

From what I can see, the US has got much better at this post-9/11 than before.

On the original public tender that milnews posted, you'll find some of the very interesting work that the lead researcher (Dr. David Mandel's) is doing on these and other issues listed here.

...the money might be better spent elsewhere

Cognitive biases are pretty well understood already. Hopefully this isn't reinventing the wheel, particularly since this is contracted research.

What's really needed IMO is better training for analysts and the money, IMO, would be better spent there.

Hi Rex,

Quote:

---

Originally Posted by Rex Brynen

We have some absolutely top-notch analysts—and, obviously, some less so. HOWEVER, one disadvantage of having a very small community is... that we have a very small community. Consequently, there is less opportunity for exchanging ideas/debating/challenging assumptions/etc. Virtually all of the folks that work on the Middle East, for example, could comfortably fit into the Sparks Street Tim Hortons for a double-double.

---

Unfortunate, but true.

Quote:

---

Originally Posted by Rex Brynen

There are ways of offsetting that, of course--for example, by bringing folks into discussions who aren't in the IC, but rather in the aid, diplomatic, or even (heaven forbid) the academic and NGO communities. Some agencies and managers do it. Some don't.

---

Also works in reverse - one of my colleagues is ex-MI. Still, stovepiping is a major problem all around. On that note, are you coming to Ottawa for CASIS this year? It's looking like I will be there and I am expecting some lively discussions (in the bars and Timmy's, not the panels!) on recent CSIS "revelations".

Cheers,

Marc

Quote:

---

Originally Posted by Entropy

Cognitive biases are pretty well understood already. Hopefully this isn't reinventing the wheel, particularly since this is contracted research.

---

is anyone like, you know, doing anything about that?

All the real benefit I saw was in the last item quoted: "...and (c) to examine the viability of counter-measures aimed at reducing or eliminating them...."

That biases are known to exist and the issue is recognized is totally true, my perception is that little has been done to correct the problem for fear of trampling artistic little psyches (pardon my hyperbole and present company excepted but there are some out there...) OR, far more importantly, of not giving the Boss what he's looking for by skewing the analytical process to suit.

I will avoid mention of an overwhelming desire on the part of some to never be wrong. That based on the rationale that if you do not go out on a limb, they cannot or will not cut it off... :wry: (An attitude that I have on a couple of occasions seen proven mistaken by irate Commanders not apprised of all that was known. :D).

Agree with your sentiment on contractors but have to point out that in-house studies tend to reach foregone conclusions (dare I say preordained?) and little changes. Outside studies sometimes have an effect.

In this case, as I understand it, the contractors are largely administering the tests and providing the data, not actually doing the analysis.

Also, there are biases and there are biases. The focus here is on some pretty specific issues that may not have been adequately explored, such as whether formal methods to reduce certain types of bias (for example, Analysis of Competing Hypotheses methodologies) might actually introduce other sorts of biases (for example, ones associated with the the sequencing of information); the impact that classification levels may have on the perceived weight of information (less a problem among analysts who understand how sausages are made than clients who consume the output, in my view); how probability assessments may be skewed by psychological processes, etc.

I don't think it is reinventing wheels.

Quote:

---

Originally Posted by marct

On that note, are you coming to Ottawa for CASIS this year?

---

I will if I can, but I may have to be somewhere more Middle Eastern those particular days.

Quote:

---

I am expecting some lively discussions (in the bars and Timmy's, not the panels!) on recent CSIS "revelations".

---

On the current issues with CSIS, the courts, and security certificates, I think this is proof that the 2008 changes introduced to the security certificate system (at the insistence of the Supreme Court) have been useful.

Under the old system, the government presented two cases: a public unclassified one, and a private classified one wherein only the judge (and not the defence lawyers) heard the supposed evidence. Under the new system (like that in the UK), special advocate working for the defence team with appropriate clearances has the opportunity to review and challenge the classified part of the evidence presented.

The need for the system was evident to me some years ago, when I was an expert witness in the public part of a trial under the old system. The government's unclassified presentation was full of errors: at one point they confused an elderly history professor with the head of Fateh's Force 17 executive protection/special activities group; another time, they presented varying transliterations of the same Arabic name (by visa clerks) as evidence of using aliases; and so forth. It made me wonder what weaknesses were in the secret version of the evidence, and how on earth the judge could possibly know what was accurate in the absence of a counsel for the defence being present to challenge and raise questions.

Quote:

---

Originally Posted by Ken White

is anyone like, you know, doing anything about that?

All the real benefit I saw was in the last item quoted: "...and (c) to examine the viability of counter-measures aimed at reducing or eliminating them...."

---

Over the decades many analytic methods have been developed that specifically seek to reduce or eliminate bias. There are a least a couple of dozen general methods and many more tailored for specific problems. Too many analysts do not even know these methods exist, much less have the training to use them properly, or, if trained, the time to utilize them properly.

Quote:

---

That biases are known to exist and the issue is recognized is totally true, my perception is that little has been done to correct the problem for fear of trampling artistic little psyches (pardon my hyperbole and present company excepted but there are some out there...) OR, far more importantly, of not giving the Boss what he's looking for by skewing the analytical process to suit.

---

In my experience it's more often the Boss that does the skewing since most are not receptive to information that conflicts with what they believe. Beyond that perpetual tension, I think it's fine to do yet more research but IMO the problems with intelligence do not stem from a lack of knowledge on cognitive bias, nor a dearth of methods to combat that bias. There are a host of structural and bureaucratic problems but at the analyst level the three biggest problems I see are:

1. Lack of analyst training.
2. Lack of analyst introspection and self-awareness.
3. Lack of analyst curiosity.

The latter two problems stem, IMO, from a limited pool of analyst candidates (and is a topic that deserves its own thread). The first problem is something that can and should be solvable but is perennial. Look at the intelligence schoolhouse for any of the services. The vast majority of training time is spent on memorizing information, briefing skills, and intel systems. Those are important, but there is comparatively little (or nothing) on researching skills (beyond "look in the pub" or "search siprnet"), evaluating information, strengths and weakness of the differents "ints" (and what they can and can't provide) along with actual analysis.

Quote:

---

I will avoid mention of an overwhelming desire on the part of some to never be wrong. That based on the rationale that if you do not go out on a limb, they cannot or will not cut it off... :wry: (An attitude that I have on a couple of occasions seen proven mistaken by irate Commanders not apprised of all that was known. :D).

---

That's undoubtedly true and, as you mention, at times there are strong incentives to never be wrong even if that means being useless or never being right either. This is another topic that we could discuss at length since it is deep and endemic.

Quote:

---

Agree with your sentiment on contractors but have to point out that in-house studies tend to reach foregone conclusions (dare I say preordained?) and little changes. Outside studies sometimes have an effect.

---

True, sometimes they do but mostly they don't. When they do the effect is usually temporary until the next intelligence failure comes along.

Rex,

Quote:

---

Also, there are biases and there are biases. The focus here is on some pretty specific issues that may not have been adequately explored, such as whether formal methods to reduce certain types of bias (for example, Analysis of Competing Hypotheses methodologies) might actually introduce other sorts of biases (for example, ones associated with the the sequencing of information); the impact that classification levels may have on the perceived weight of information (less a problem among analysts who understand how sausages are made than clients who consume the output, in my view); how probability assessments may be skewed by psychological processes, etc.

---

Then it's probably valuable research but the sad reality is that the vast majority of such research never trickles-down to impact the individual analyst.

....into how the bad guy does things, and how to predict what they'll do.

Public posting:

Quote:

---

The Department of National Defence, Defence Research and Development (DRDC), Toronto, Ontario has a requirement for the provision of Scientific & Technical support for behavioral, cognitive, and social sciences research in various security environments and operational contexts. Examples of such contexts include command, communications, computer intelligence, surveillance and reconnaissance; collection, analysis and dissemination of intelligence products; effects-based operations; all with an explicit focus on human performance at the individual group and organizational levels.

---

Now, a bit more detail from the Statement of Work here:

Quote:

---

“DRDC Toronto is now actively building its capacity for human sciences in a new research domain: Understanding, prediction and influence of adversaries’ intent …. DRDC requires contractual support for research in this new area. In particular, the Adversarial Intent Section (AIS) of DRDC Toronto anticipates a requirement for significant research effort that addresses the following general topic:

(a) eludication of contemporary security concepts such as Effects-based Approaches to Operations (EBAO), Defence Development and Diplomacy (3D), and the Comprehensive approach (CA) and their use in military capability development and doctrine;

(b) understanding the social, organizational, and cognitive determinants of human capabilities for the effective production of military and civilian intelligence pertinent to domestic and international issues;

(c) influence processes that play a role in conflict-ridden environments characterized by complex interactions among adversaries, allied forces, and bystander groups; (and)

(d) methods and tools for structuring, portraying and analyzing complex contemporary security environments.”

---

I've "plain languaged" it a bit here.

This, from Wired.com's Danger Room:

Quote:

---

The U.S intelligence community has a long history of blowing big calls — the fall of the Berlin Wall, Saddam’s WMD, 9/11. But in each collective fail, there were individual analysts who got it right. Now, the spy agencies want a better way to sort the accurate from the unsound, by applying principles of mathematics to weigh and rank the input of different experts.

Iarpa, the intelligence community’s way-out research arm, will host a one-day workshop on a new program, called Aggregative Contingent Estimation (ACE). The initiative follows Iarpa’s recent announcement of plans to create a computational model that can enhance human hypotheses and predictions, by catching inevitable biases and accounting for selective memory and stress.

ACE won’t replace flesh-and-blood experts — it’ll just let ‘em know what they’re worth. The intelligence community often relies on small teams of experts to evaluate situations, and then make forecasts and recommendations. But a team is only as strong as its weakest link, and Iarpa wants to fortify team-based outputs, by using mathematical aggregation to “elicit, weigh, and combine the judgments of many intelligence analysts" ....

---

I found him to be spot on. It's not possible to eliminate cognitive biases from the analyst entirely, as they're based in how we learn and incorporate knowledge. What IS possible is significant mitigation of those biases by first being trained to identify them; second being willing to address them; third being trained in structured analytic methodologies which go far in levelling the analytic playing field; fourth being willing to retool theories to fit the facts rather than retooling the facts to fit the theories.

The fourth I perceive to be the most important - and least engaged.

On the previously mentioned structured analytic method ACH, I found that Heuer's software was effective in mitigating cognitive bias (as is a simple hand-written matrix, BTW) but only if it's worked in a particular fashion.

As an example:
Any typical competing hypotheses matrix has a fairly straightforeward design. The first column on the left is populated with all of the facts generated by the analyst's research. The top cell of the second, third, fourth columns (et cetera) contain ALL working hypotheses, each in its own column. There may be several variations on a couple themes, or simply a pair of mutually exclusive theories.

The analyst then examines the facts in relation to the hypothesies, determining consistency, lack of applicability, or inconsistency. But this is where I found that the way this simple matrix is worked matters regarding the outcome.

The first couple of times I utilised ACH software, while in college in intelligence analysis classes, I had not yet learned that there may be a difference in how the process should be run for assuring the least bias possible. So I started at the top of the column for Hypothesis A, and worked my way down. I compared data points 1-45 to Hypothesis A, attempting to assign a value (highly consistent, consistent, not applicable, inconsistent, highly inconsistent) to each data point as it related to Hypothesis A. Then I went through the same exercise with the same data for Hypothesis B's column.

What a mess. For the particular project I was working on at the time, my results were inconclusive and an exercise in frustration.

Finally another student clued me in. Work across! Is data point 2 consistent, not applicable, or inconsistent with Hypothesis A? Is data point 2 consistent, not applicable, or inconsistent with Hypothesis B? C? Next, is data point 3 consistent, not applicable, or inconsistent with Hypothesis A? B? C? Working across, apply a data point to all hypotheses, then the next fact, then the next, down the matrix.

I will tell you that it surprised the heck out of me to find that, without having rearranged or changed ANY of my data points or hypotheses, the direction in which I worked the matrix made a HUGE difference in the utility of the results.

Next, what must be done is to eliminate (or rework) the hypotheses which have large numbers either of "not applicables" or "inconsistents" in their column.

Having just spent the last year working on the problem of US border security and Mexican drug cartel violence in Texas, I've watched several coworkers repetitively discard confirmed data because it doesn't fit their theories. This stuff has frustrated the living tar out of me! The individuals in question habitually cherry-picked the facts to "prove" their hypotheses, rather than working at trying to disprove all theories. That hypothesis which is least able to be disproven tends to have the highest validity.

Structured methodology, such as those tools identified and taught by Richards Heuer and Morgan Jones (among others) are the best tools I've found for removing ego and bias from the work of being an analyst.

As mentioned or alluded to in previous posts, the wheel does not need to be reinvented, nor does the process by which it rolls need to be studied again some more. The tools are there, and have been highly effective for decades; but they must be taught consistently and reinforced often throughout intelligence analysts' careers, regardless of venue or gov't agency.

A bit of follow-up work - from the paper's abstract:

Quote:

---

Intelligence analysis provides important informational support to civilian and military decision makers. Recent intelligence failures of Canada’s allies have been attributed mostly to cognitive, social, and organizational deficits and biases of individual analysts and intelligence agencies. Such attributions call for a comprehensive examination of intelligence production from the sociopsychological perspective. The present report discusses findings from interviews conducted with Canadian managers of intelligence analysts. The interviewed managers identified a number of pertinent issues in the intelligence production process that may be explicated through the application of the behavioural sciences’ accumulated knowledge and methodology. The identified issues are discussed in light of the intelligence studies and behavioural sciences literature, and a roadmap for the behavioural sciences research program in support of the intelligence function is outlined.

---

Executive summary downloadable (right click and "Save as") here, full report downloadable here.

In my collection and analysis class I use Heuer as one of my readings, as I, too, believe that he is spot on. There are numerous recommendations on how to overcome the effects of various biases. I introduce critical thinking as advocated by Tim VanGelder, but also use Cass Sunstein's book Infotopia, which examines statistical norming, market models, and internet collaboration a' la intellipedia.

Based on my depraved development, I am convinced that learning critical thinking and alternative analysis can assist analysts in overcoming the pitfalls of being "normal".

But it will be interesting to see what any new data may reveal, or not reveal.

Last month I attended this international conference in London, hosted by the intelligence and security Studies of Brunel University and the University of Mississippi, a rather unconventional mix was on offer:

Quote:

---

...cross-disciplinary discussion about the value of learning from other fields to improve both the understanding and the practice of intelligence analysis.

Professionals in other fields—including medicine, the social and behavioural sciences, history and historiography, anthropology and other disciplines engaged in ethnographic research, econometric forecasting, and legal reasoning—also face many similar challenges to those that exist in intelligence analysis, including:

Difficulties acquiring information from a wide variety of sources
Vetting and evaluating the information that is acquired
Deriving understanding and meaning from that information
Impact of deadlines, editing, and other production processes on accuracy of analysis and assessment
Problems in dissemination and distribution to consumers or customers
Managing relationship between producer and consumer (role, responsibility, independence & objectivity)
Developing professional infrastructure (recruit, select, train, & develop personnel; code of ethics)
Overcoming impact of changing technology and alternative information distribution systems
How do practitioners in various non-intelligence fields overcome these kinds of challenges? How are their challenges similar to or different from those that exist in the intelligence arena? What can be learned from the comparison?

---

Most of the presentations are on:http://sas.olemiss.edu/bciss/materials.php

Fixing Intelligence Analysis: From Specialists to Experts

Bias and Perception: How if Affects Our Judgment in Decision Making and Analysis

Dangers of Ethnicity in Analysis

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Community Ecosystem Analysis

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Qualitative Analysis Concept in Support of Force 2025 and Beyond (F2025B) Maneuvers

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Using Target Audience Analysis to Aid Strategic Level Decisionmaking

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Strategic Studies Institute: Research and Analysis

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Center of Gravity Analysis "Down Under": The Australian Defence Force's New Approach

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Enabling Smart City Resilience Through Center of Gravity Analysis

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Advancing Intelligence Analysis for the Multi-Domain Battlefield

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Odd timing for such an article after recent publicity over the mistakes made, but this is Germany. At a minimum it is a pointer to the assessment tool developed and in use. Here is a key phrase:

Quote:

---

But it's no great skill to identify people who are highly violent...The skill is in categorizing the people who are not dangerous among the people defined as endangerers.

---

Link:http://www.dw.com/en/only-half-of-da...ce/a-41848406?

There are just over seventy threads that have 'analysis' in the title; most a specific to a campaign or theme, whereas this one is concerned with intelligence analysis, overcoming bias and learning. Three threads have been merged here and the former phrase has become the title. All prompted by the next post.

The CIA has released this book 'Psychology of Intelligence Analysis' by Richard Heuer, as a free PDF, spotted via Twitter:

Quote:

---

Did you know that the CIA released a free PDF on how to analyze OSINT Well, it wasn't JUST for OSINT. It discusses bias and how to keep an open mind when performing analyses. Worth a download and read.

---

Amidst all the explanations this is the best:

Quote:

---

Dick Heuer's writings make three fundamental points about the cognitive challenges intelligence analysts face:

• The mind is poorly "wired" to deal effectively with both inherent uncertainty (the natural fog surrounding complex, indeterminate intelligence issues) and induced uncertainty (the man-made fog fabricated by denial and deception operations).
• Even increased awareness of cognitive and other "unmotivated" biases, such as the tendency to see information confirming an already-held judgment more vividly than one sees "disconfirming" information, does little by itself to help analysts deal effectively with uncertainty.
• Tools and techniques that gear the analyst's mind to apply higher levels of critical thinking can substantially improve analysis on complex issues on which information is incomplete, ambiguous, and often deliberately distorted. Key examples of such intellectual devices include techniques for structuring information, challenging assumptions, and exploring alternative interpretations.

---

Link:https://www.cia.gov/library/center-f...gence-analysis

Understanding Culture Requires a New Approach to Its Analysis

Entry Excerpt:



--------
Read the full post and make any comments at the SWJ Blog.
This forum is a feed only and is closed to user comments.

Quote:

---

In the spring of 1997, a 14-year-old’s school science fair project made a convincing argument to ban a dangerous chemical compound: dihydrogen monoxide, known as DHMO. Nathan Zohner, a junior high school student in Idaho, gave 50 of his fellow students a report called "Dihydrogen Monoxide: The Unrecognized Killer,” which accurately laid out the dangers of DHMO, convincing the majority of students to call for its ban. The experiment caused enough of a splash that it was picked up by The Washington Post

---

http://mentalfloss.com/article/50190...rogen-monoxide

Straight out of a Hollywood script

Quote:

---

Following misrepresentations by a white nationalist leader and coordinated efforts by internet trolls, numerous researchers and media outlets spread a seemingly false claim that the man charged with killing more than a dozen people at a Florida high school belonged to an extremist group.

Law enforcement agencies say they have no evidence so far to support this claim, and the rumor appears to have been perpetrated by white nationalist trolls themselves.

---

Money shot.

Quote:

---

“[T]hey are so hungry for a story that they'll just believe anything as long as its corroborated by a few people and seems legit,” wrote the creator of one 4chan thread.

---

https://www.politico.com/story/2018/...415672?cid=apn

Tangential technology due to inevitably intersect this topic.

Fake videos are on the rise. As they become more realistic, seeing shouldn't always be believing

Quote:

---

With more time, Pinscreen, the Los Angeles start-up behind the technology, believes its renderings will become so accurate they will defy reality.
"You won't be able to tell," said Hao Li, a leading researcher on computer-generated video at USC who founded Pinscreen in 2015. "With further deep-learning advancements, especially on mobile devices, we'll be able to produce completely photoreal avatars in real time."

---

Quote:

---

Now imagine a phony video of North Korean dictator Kim Jong Un announcing a missile strike. The White House would have mere minutes to determine whether the clip was genuine and whether it warranted a retaliatory strike.
What about video of a presidential candidate admitting to taking foreign cash? Even if the footage proved fake, the damage could prove irreversible.
In some corners of the internet, people are using open-source software to swap celebrities' faces into pornographic videos, a phenomenon called Deep Fakes.

---

Note: soft paywall
http://www.latimes.com/business/tech...219-story.html

Cross-posted on the Israeli intelligence thread. Note this is a free, online book (222 pgs0 and not read here yet.:(

An offering from an ex-IDF officer via the ITIC and the recommendation is byMajor General Herzi Halevi, Chief of Defense Intelligence:

Quote:

---

Itai Brun’s book deals with intelligence analysis – the process in which knowledge about the enemy and the environment is developed to serve decision-making in the fields of policy design, operational planning and force build up. Among other things, the book relates to the nature of intelligence analysis, the analysis methodology, the role of intelligence analysis in combat, and the impact of the information revolution on the analysis practice.

Having known him for many years, both as a commander and an intelligence officer, Itai’s skill at describing and explaining complex reality has always stood out. In his book, he provides up-to-date insight into the methodology and philosophy of intelligence analysis, an area hardly broached let alone written about. Brun presents his own experience and the best practices of the entire Israeli intelligence community, and he does so, as always, in a clear and concise manner.

---

Link:https://www.terrorism-info.org.il/en...matic-changes/