广州市黄埔区学大道揽月路广州企业孵化器B座402
电话:020-85625352
手机:18102256923、18102253682
Email:servers@gzscbio.com
Fax:020-85625352
QQ:386244141
项目名称:CHIP分析qc解读报告链接
所属分类:生物信息学分析-报告解读
联系电话:020-85625352
QQ:386244141
Email:servers@gzscbio.com
技术服务描述
QC Report
general | |
---|---|
Report generated at | 2021-01-13 22:36:11 |
Title | Demo-H3K27me3 |
Description | This is a input JSON for Demo-H3K27me3. |
Pipeline version | v1.3.4 |
Pipeline type | histone |
Genome | mm10 |
Aligner | bowtie2 |
Sequencing endedness | OrderedDict([('rep1', {'paired_end': True}), ('rep2', {'paired_end': True}), ('ctl1', {'paired_end': True}), ('ctl2', {'paired_end': True})]) |
Peak caller | macs2 |
Report QC介绍基本信息,说明:
报告发布时间
报告类型atac
比对基因组使用的是什么,如mm10,hg38,rn6
比对软件bowtie2
测序类型为双端测序(paired end)
peak caller 软件为 macs2
Alignment quality metrics (比对质量检测)
SAMstat (raw unfiltered BAM) (原始比对质量检测)
rep1 | rep2 | ctl1 | ctl2 | |
---|---|---|---|---|
Total Reads | 32765368 | 36715350 | 37764744 | 56655974 |
Total Reads (QC-failed) | 0 | 0 | 0 | 0 |
Duplicate Reads | 0 | 0 | 0 | 0 |
Duplicate Reads (QC-failed) | 0 | 0 | 0 | 0 |
Mapped Reads | 30605153 | 34442186 | 36046712 | 53778547 |
Mapped Reads (QC-failed) | 0 | 0 | 0 | 0 |
% Mapped Reads | 93.4 | 93.8 | 95.5 | 94.89999999999999 |
Paired Reads | 32765368 | 36715350 | 37764744 | 56655974 |
Paired Reads (QC-failed) | 0 | 0 | 0 | 0 |
Read1 | 16382684 | 18357675 | 18882372 | 28327987 |
Read1 (QC-failed) | 0 | 0 | 0 | 0 |
Read2 | 16382684 | 18357675 | 18882372 | 28327987 |
Read2 (QC-failed) | 0 | 0 | 0 | 0 |
Properly Paired Reads | 28956602 | 32820494 | 34391790 | 51050556 |
Properly Paired Reads (QC-failed) | 0 | 0 | 0 | 0 |
% Properly Paired Reads | 88.4 | 89.4 | 91.10000000000001 | 90.10000000000001 |
With itself | 29925008 | 33702510 | 35310142 | 52610300 |
With itself (QC-failed) | 0 | 0 | 0 | 0 |
Singletons | 680145 | 739676 | 736570 | 1168247 |
Singletons (QC-failed) | 0 | 0 | 0 | 0 |
% Singleton | 2.1 | 2.0 | 2.0 | 2.1 |
Diff. Chroms | 242724 | 193541 | 133840 | 201009 |
Diff. Chroms (QC-failed) | 0 | 0 | 0 | 0 |
原始数据比对基因组过程的质控:
Total Reads,为全部reads数。
duplicate Reads,为重复reads数,需要去除。
Mapped Reads,为mapping到基因组上的reads数。
% Mapped Reads,为reads的mapping率。
(大于90%非常好,大于80%较好,较低时可考虑是否是实验的特殊处理或其他污染导致。)Properly Paired Reads,正确匹配的双端reads。
% Properly Paired Reads,reads 双端匹配率。
With itself,双端匹配到基因组上的reads。
singleton,只有单端匹配到基因组上的reads。
% singleton,只有单端的匹配率。
Diff.Chroms,没有匹配到基因组上的数据。
Marking duplicates (filtered BAM) (重复数据标记检测)
rep1 | rep2 | ctl1 | ctl2 | |
---|---|---|---|---|
Unpaired Reads | 0 | 0 | 0 | 0 |
Paired Reads | 12197827 | 13976665 | 12342448 | 18114406 |
Unmapped Reads | 0 | 0 | 0 | 0 |
Unpaired Duplicate Reads | 0 | 0 | 0 | 0 |
Paired Duplicate Reads | 1012356 | 1157778 | 957195 | 1482042 |
Paired Optical Duplicate Reads | 72362 | 83973 | 66941 | 116859 |
% Duplicate Reads | 8.2995 | 8.2836 | 7.7553 | 8.1816 |
Filtered out (samtools view -F 1804):
read unmapped (0x4)
mate unmapped (0x8, for paired-end)
not primary alignment (0x100)
read fails platform/vendor quality checks (0x200)
read is PCR or optical duplicate (0x400)
说明:
Duplicate Reads是由于PCR过度扩增,导致的完全一致的reads,这些reads在分析时需要去除。利用samtools过滤掉的数据包括:
unmapped的reads(单端/双端)
没有唯一匹配的reads
本身质量差的reads
PCR重复产生的duplicate reads
SAMstat (filtered/deduped BAM) (过滤掉线粒体reads及重复reads后的质量检测)
rep1 | rep2 | ctl1 | ctl2 | |
---|---|---|---|---|
Total Reads | 22370942 | 25637774 | 22770506 | 33264728 |
Total Reads (QC-failed) | 0 | 0 | 0 | 0 |
Duplicate Reads | 0 | 0 | 0 | 0 |
Duplicate Reads (QC-failed) | 0 | 0 | 0 | 0 |
Mapped Reads | 22370942 | 25637774 | 22770506 | 33264728 |
Mapped Reads (QC-failed) | 0 | 0 | 0 | 0 |
% Mapped Reads | 100.0 | 100.0 | 100.0 | 100.0 |
Paired Reads | 22370942 | 25637774 | 22770506 | 33264728 |
Paired Reads (QC-failed) | 0 | 0 | 0 | 0 |
Read1 | 11185471 | 12818887 | 11385253 | 16632364 |
Read1 (QC-failed) | 0 | 0 | 0 | 0 |
Read2 | 11185471 | 12818887 | 11385253 | 16632364 |
Read2 (QC-failed) | 0 | 0 | 0 | 0 |
Properly Paired Reads | 22370942 | 25637774 | 22770506 | 33264728 |
Properly Paired Reads (QC-failed) | 0 | 0 | 0 | 0 |
% Properly Paired Reads | 100.0 | 100.0 | 100.0 | 100.0 |
With itself | 22370942 | 25637774 | 22770506 | 33264728 |
With itself (QC-failed) | 0 | 0 | 0 | 0 |
Singletons | 0 | 0 | 0 | 0 |
Singletons (QC-failed) | 0 | 0 | 0 | 0 |
% Singleton | 0.0 | 0.0 | 0.0 | 0.0 |
Diff. Chroms | 0 | 0 | 0 | 0 |
Diff. Chroms (QC-failed) | 0 | 0 | 0 | 0 |
Filtered and duplicates removed
说明:
duplicate reads,对过滤后的reads进行质控。表格说明同上。
Sequence quality metrics (filtered/deduped BAM) (测序质量检测)
Open chromatin assays are known to have significant GC bias. Please take this into consideration as necessary.
说明:
红色线条为每条序列在基因组特定位置的均一化覆盖度,
蓝色线条为每条序列的平均碱基的质量
绿色线条为每条碱基的GC含量,正常一般分布在50%左右,
每条序列的平均碱基的质量参考说明:
Phred分值 不正确的碱基识别 碱基正确识别率 Q.sorce 10 1/10 90% Q10 20 1/100 99% Q20 30 1/1000 99.9% Q30 40 1/10000 99.99% Q40
Library complexity quality metrics (文库复杂度质量检测)
Library complexity (filtered non-mito BAM) (文库复杂度)
rep1 | rep2 | ctl1 | ctl2 | |
---|---|---|---|---|
Total Fragments | 12197510 | 13975709 | 12339741 | 18110126 |
Distinct Fragments | 11191647 | 12825074 | 11392158 | 16645601 |
Positions with Two Read | 878017 | 1003321 | 812861 | 1253221 |
NRF = Distinct/Total | 0.917535 | 0.917669 | 0.923209 | 0.919132 |
PBC1 = OneRead/Distinct | 0.916077 | 0.916322 | 0.924052 | 0.919924 |
PBC2 = OneRead/TwoRead | 11.67678 | 11.712997 | 12.95049 | 12.218665 |
Mitochondrial reads are filtered out by default. The non-redundant fraction (NRF) is the fraction of non-redundant mapped reads in a dataset; it is the ratio between the number of positions in the genome that uniquely mapped reads map to and the total number of uniquely mappable reads. The NRF should be > 0.8. The PBC1 is the ratio of genomic locations with EXACTLY one read pair over the genomic locations with AT LEAST one read pair. PBC1 is the primary measure, and the PBC1 should be close to 1. Provisionally 0-0.5 is severe bottlenecking, 0.5-0.8 is moderate bottlenecking, 0.8-0.9 is mild bottlenecking, and 0.9-1.0 is no bottlenecking. The PBC2 is the ratio of genomic locations with EXACTLY one read pair over the genomic locations with EXACTLY two read pairs. The PBC2 should be significantly greater than 1. See more details at the ENCODE portal standard for ChIP-Seq pipeline
NRF (non redundant fraction)
PBC1 (PCR Bottleneck coefficient 1)
PBC2 (PCR Bottleneck coefficient 2)
PBC1 is the primary measure. Provisionally
0-0.5 is severe bottlenecking
0.5-0.8 is moderate bottlenecking
0.8-0.9 is mild bottlenecking
0.9-1.0 is no bottlenecking
说明:
Total Fragments:总片段数
Distinct Fragments:可以唯一匹配到基因组上的片段数
One Reads:只有一个reads匹配到特定位置的片段数
Two Read:有两个reads匹配的同一位置的片段数
NRF = Distinct/Total
PBC1 = OneRead/Distinct
PBC2 = OneRead/TwoRead
文库复杂度的指标由三个值决定,NRF、PBC1、PBC2,其中最重要的为PBC1的数值
ENCODE对文库复杂度的要求如下,
PBC1 PBC2 Bottlenecking level NRF Complexity Flag colors < 0.7 <1 Severe < 0.7 Concerning Orange 0.7 <= PBC1 <= 0.9 1 <= PBC2 <= 3 Moderate 0.7 <= NRF <= 0.9 Acceptable Yellow > 0.9 >3 None > 0.9 ldeal None
Replication quality metrics (重复性质量检测)
IDR (Irreproducible Discovery Rate) plots (不可重复发现率)
(可选,仅在有至少2组重复(rep1,rep2,...)时计算)
IDR主要比较两个样本之间的重复性,先对peaks进行排序,然后进行重复性的分析,得到IDR得分。IDR<0.05,认为有重复性,黑色表示,IDR>=0.05认为没有重复性,红色表示。
一般对两重复样本进行IDR检测(rep1 vs rep2),检测两样本之间的重复性。
单样本的虚拟样本间也可进行IDR检测(rep1-pr1 vs rep1-pr2),验证IDR检测的准确性。
样本混样成pool进行IDR检测(pool-pr1 VS pool-pr2)
Reproducibility QC and peak detection statistics(重复性QC及peak统计分析)
overlap | |
---|---|
Nt | 69675 |
N1 | 57215 |
N2 | 50331 |
Np | 65776 |
N optimal | 69675 |
N conservative | 69675 |
Optimal Set | rep1_vs_rep2 |
Conservative Set | rep1_vs_rep2 |
Rescue Ratio | 1.059276939917295 |
Self Consistency Ratio | 1.1367745524626969 |
Reproducibility Test | pass |
Reproducibility QC
N1: Replicate 1 self-consistent peaks (comparing two pseudoreplicates generated by subsampling Rep1 reads)
N2: Replicate 2 self-consistent peaks (comparing two pseudoreplicates generated by subsampling Rep2 reads)
Ni: Replicate i self-consistent peaks (comparing two pseudoreplicates generated by subsampling RepX reads)
Nt: True Replicate consistent peaks (comparing true replicates Rep1 vs Rep2)
Np: Pooled-pseudoreplicate consistent peaks (comparing two pseudoreplicates generated by subsampling pooled reads from Rep1 and Rep2)
Self-consistency Ratio: max(N1,N2) / min (N1,N2)
Rescue Ratio: max(Np,Nt) / min (Np,Nt)
Reproducibility Test: If Self-consistency Ratio >2 AND Rescue Ratio > 2, then 'Fail' else 'Pass'
说明:
N1: replicate1自我虚拟peak的一致性peak
N2: replicate2自我虚拟peak的一致性peak
Ni: replicatei自我虚拟peak的一致性peak
Nt: 真实一致性的peak
Np: 整体的数据(pool)自我虚拟peak的一致性peak
N optimal: 虚拟peak的一致性peak
N conservation: 真实peak的一致性peak
Self-consistency Ratio: max(N1,N2) / min (N1,N2)
Rescue Ratio: max(Np,Nt) / min (Np,Nt)
Reproducibility Test: 如果Self-consistency Ratio >2 AND Rescue Ratio > 2, 则失败(Failed),否则通过(pass)
ENCODE对以上指标的检测标准如下:
Self-consistency Ratio Rescue Ratio Resulting Data Status Flag colors Less than 2 Less than 2 Ideal None Less than 2 Greater than 2 Acceptable Yellow Greater than 2 Less than 2 Acceptable Yellow Greater than 2 Greater than 2 Concerning Orange
IDR 一致的peak 最好大于70,000 ,不少于50,000 为可接受
Number of raw peaks (原始peaks数)
rep1 | rep2 | |
---|---|---|
Number of peaks | 222897 | 181249 |
Top 500000 raw peaks from macs2 with p-val threshold 0.01
说明:
原始peak数最好不少于150,000,不少于100,000为可接受
Peak calling statistics (peak calling统计)
Peak region size (peak长度范围)
rep1 | rep2 | overlap_opt | |
---|---|---|---|
Min size | 145.0 | 145.0 | 145.0 |
25 percentile | 167.0 | 166.0 | 344.0 |
50 percentile (median) | 244.0 | 234.0 | 573.0 |
75 percentile | 398.0 | 371.0 | 1046.0 |
Max size | 29358.0 | 20650.0 | 58300.0 |
Mean | 407.57078830132303 | 380.0660693300377 | 973.742691065662 |
说明:
图形横坐标为region size,纵坐标为peak数。
Rep1与rep2显示的是原始peaks(去除duplicate及线粒体基因组)
Idr_opt显示的是经过IDR优化后的peaks
Overlap_opt显示经过overlap优化后的peaks
Enrichment / Signal-to-noise ratio
Strand cross-correlation measures (trimmed/filtered SE BAM) (链互相关检测)
rep1 | rep2 | |
---|---|---|
Number of Subsampled Reads | 12851530 | 14654164 |
Estimated Fragment Length | 145 | 145 |
Cross-correlation at Estimated Fragment Length | 0.163501733940247 | 0.174463103738491 |
Phantom Peak | 145 | 135 |
Cross-correlation at Phantom Peak | 0.1635017 | 0.1744216 |
Argmin of Cross-correlation | 1500 | 1500 |
Minimum of Cross-correlation | 0.1551336 | 0.1689095 |
NSC (Normalized Strand Cross-correlation coeff.) | 1.053942 | 1.032879 |
RSC (Relative Strand Cross-correlation coeff.) | 1.0 | 1.00753 |
Performed on subsampled (15000000) reads mapped from FASTQs that are trimmed to 50. Such FASTQ trimming and subsampling reads are for cross-corrleation analysis only. Untrimmed FASTQs are used for all the other analyses.
NOTE1: For SE datasets, reads from replicates are randomly subsampled to 15000000.
NOTE2: For PE datasets, the first end (R1) of each read-pair is selected and trimmed to 50 the reads are then randomly subsampled to 15000000.
Normalized strand cross-correlation coefficient (NSC) = col9 in outFile
Relative strand cross-correlation coefficient (RSC) = col10 in outFile
Estimated fragment length = col3 in outFile, take the top value
NSC与RSC的算法如下:
从flitered BAM文件中虚拟一个含有25,000,000个reads的副本,并对该副本进行链互相关分析。链互相关性分析主要显示+,-链reads的相似性。由于正负reads的peak中心有偏移,因此,结果中一般会出现两个peak,一个是标准peak,一个是虚拟peak( Phantom Peak)。如下图所示
Jensen-Shannon distance (filtered/deduped BAM)(JS散度检测)
rep1 | rep2 | |
---|---|---|
AUC | 0.1747780085641306 | 0.19630546999584553 |
Synthetic AUC | 0.49369100397133525 | 0.4938306458383708 |
X-intercept | 0.2814028450423717 | 0.2282392651040396 |
Synthetic X-intercept | 2.833074277847546e-215 | 3.311809264890219e-225 |
Elbow Point | 0.6829741370691345 | 0.6637998952205367 |
Synthetic Elbow Point | 0.5077616252755175 | 0.5090817373473214 |
JS Distance | 0.15457967388718868 | 0.1319724797088127 |
Synthetic JS Distance | 0.3844893157186109 | 0.36697074507783967 |
% Genome Enriched | 26.773152462117427 | 27.906330359249587 |
Diff. Enrichment | 35.52863604550958 | 32.38593833632243 |
CHANCE Divergence | 0.30759877464436847 | 0.27907882507917986 |
说明:
JS散度是检测两样本之间的离散程度,也就是检测两样本之间的相似性。
Peak enrichment
Fraction of reads in peaks (FRiP) (peaks占总reads数的比值)
FRiP for macs2 raw peaks
rep1 | rep2 | rep1-pr1 | rep2-pr1 | rep1-pr2 | rep2-pr2 | pooled | pooled-pr1 | pooled-pr2 | |
---|---|---|---|---|---|---|---|---|---|
Fraction of Reads in Peaks | 0.29828399716024473 | 0.21805804981352905 | 0.2650521140279105 | 0.21015824461528956 | 0.2683713782255015 | 0.2142321883508442 | 0.2643710154631088 | 0.24142476616747957 | 0.24457677598182598 |
FRiP for overlap peaks
rep1_vs_rep2 | rep1-pr1_vs_rep1-pr2 | rep2-pr1_vs_rep2-pr2 | pooled-pr1_vs_pooled-pr2 | |
---|---|---|---|---|
Fraction of Reads in Peaks | 0.20251568486022414 | 0.19483873321025105 | 0.13992583755516372 | 0.20076902285826598 |
FRiP for IDR peaks
pooled-pr1_vs_pooled-pr2 | |
---|---|
Fraction of Reads in Peaks | 0.10828106712956038 |
For macs2 raw peaks:
repX: Peak from true replicate X
repX-prY: Peak from Yth pseudoreplicates from replicate X
pooled: Peak from pooled true replicates (pool of rep1, rep2, ...)
pooled-pr1: Peak from 1st pooled pseudo replicate (pool of rep1-pr1, rep2-pr1, ...)
pooled-pr2: Peak from 2nd pooled pseudo replicate (pool of rep1-pr2, rep2-pr2, ...)
For overlap/IDR peaks:
repX_vs_repY: Comparing two peaks from true replicates X and Y
repX-pr1_vs_repX-pr2: Comparing two peaks from both pseudoreplicates from replicate X
pooled-pr1_vs_pooled-pr2: Comparing two peaks from 1st and 2nd pooled pseudo replicates
说明:
FRiP指的是fraction of all mapped reads that fall into peak regions. 代表peak区域内reads的比例,peak区域内的reads是抗体富集的序列,其他区域的序列是背景噪声。 只有mapping到基因组上的reads才会进行后续分析,所以直接用peak区域reads数目除以所有mapping基因组的数目,就得到了FRiP Score。
Encode团队发现FRip Score和peak的个数存在正相关关系。 对于不同的转录因子chip数据,peak的个数不同,总体的趋势来看,peak的个数越多,FRiP Score的值越大。在Encode的chip数据集中,有80%左右的FRiP Score值都超过了1%,所以将1%看做是一个衡量chip实验的软标准。 之所以称之为软标准,是因为FRiP score低于1%并不能直接说明chip实验是失败的,高于1%也不能直接说明chip实验就是成功的。在ZNF274和RNA III型聚合酶的chip实验中,peak的个数很少,FRiP score的值也小于1%;在CTCF等转录因子实验中,FRiP score的值又远大于1%。
所以说FRiP score值是和特定的转录因子或者组蛋白修饰相关,在研究特定转录因子时,参考别人已经发表的数据中的FRiP Score作为衡量标准是更好的,在没有参考的情况下,可以用1%的阈值来作为一个软标准,为chip实验的质量提供一个参考。当peak个数的大于1000时,1%这个标准的效果还是比较好的,有相当大的参考意义。