{ "title": "Finding a contribution in biology + computing", "started": "2026-09-19", "status": "Round 3 running: two completed studies preserved; new hypotheses and tests append below.", "mission": "Find and execute a valuable, plausibly original research contribution using public data and programming. Interests: genetics, plant design, birds and birdwatching. Failed and overlapping ideas remain visible.", "criteria": [ "A concrete biological or research-methods question with a result that could change what someone does or believes.", "Accessible data and a minimal test before expensive analysis.", "Novelty checks against the closest papers, preprints, datasets and software, repeated after larger validation.", "Alternative explanations, independent sampling and sensitivity checks addressed before claiming success.", "Reproducible code, evidence, results and a manuscript-ready account; external peer review remains necessary." ], "entries": [ { "id": "001", "title": "Are source recordings independent in a nocturnal bird-call benchmark?", "status": "Closed — no direct train/test overlap detected", "question": "Do publicly identifiable shared source recordings cross the NBM train/test split, and could this invalidate an otherwise independent comparison?", "rationale": "A direct audit is cheap and could yield a useful correction if genuine overlap exists. The authors already address sampling bias and deliberately select later uploads for testing, so general concerns about leakage are not new.", "minimal_test": "Retrieve metadata; compare recording identifiers, filenames, source origin and available contributor/session fields. If no direct overlap is found, reject this narrow lead unless independent evidence supports audio duplication.", "novelty": "Initial reading: source paper explicitly discusses class imbalance, contributor imbalance, train/test upload-date separation, possible BirdNET pretraining overlap, and focal-versus-passive domain shift. These are established issues, not our contributions.", "sources": [ { "title": "Airale, Pajot & Linossier (2026), NBM data descriptor", "url": "https://www.nature.com/articles/s41597-026-07176-5" }, { "title": "NBM versioned dataset", "url": "https://zenodo.org/records/17573913" }, { "title": "NBM source code", "url": "https://github.com/LouisBearing/BirdSoundClassif" } ], "searches": [ "\"Nocturnal Bird Migration\" dataset leakage duplicates evaluation", "\"NBM\" \"Airale\" dataset bias annotation" ], "results": [ "ZIP-directory audit: 2,348 WAV files, comprising 2,077 training and 271 test recordings.", "No shared Xeno-canto IDs and no matching size/CRC32 pairs crossed the train/test split.", "Ten matching size/CRC32 groups occur within training (21 files); exact audio identity still requires cryptographic verification. Only 579,993 bytes were downloaded for this screen." ], "decision": "Reject the narrow direct-leakage hypothesis. This test cannot exclude cropped, re-encoded or same-session recordings; no broad claim of independence is made.", "artifacts": [ { "title": "Machine-readable audit results", "path": "results/001_nbm_source_audit.json" }, { "title": "Reproducible archive audit", "path": "scripts/nbm_archive_audit.py" } ] }, { "id": "002", "title": "Can duplicate audio reveal annotation uncertainty?", "status": "Closed — annotation provenance insufficient", "question": "Can multiple annotations of repeated NBM audio quantify uncertainty in detection benchmarks?", "rationale": "The directory audit exposed repeated audio candidates with differently named annotation files.", "minimal_test": "Read the annotation files of all ten candidate groups and distinguish mere formatting, revised labels, missing files and independently drawn boundaries.", "novelty": "Inter-annotator agreement and boundary uncertainty in bioacoustics are already established topics. Accidental repeated files would only support a new result if their annotation provenance and independence were known.", "results": [ "Some duplicate candidates have different species/event coverage and boundary placement; several long recordings appear to retain revised annotation versions.", "At least one repeated WAV has no matching TXT. The extraction was corrected to retain missing-label cases explicitly.", "All ten groups were inspected: seven have paired TXT files; three include WAVs without matching TXT files. Twelve training WAVs in total lack a same-stem TXT. Missing TXT is not equivalent to a negative annotation." ], "limitations": "No annotator identity or independent repeated-labeling design is provided. CRC identity is only a screen. Ten convenience-sampled groups cannot represent the full dataset.", "decision": "Retain as a limited data-quality finding. No general uncertainty estimate and no novelty claim. Large WAV pairs were not downloaded merely to confirm this unsuitable lead.", "sources": [ { "title": "Duc et al. (2021): inter-annotator agreement in marine bioacoustics", "url": "https://doi.org/10.1016/j.ecoinf.2020.101185" }, { "title": "Automatic detection for bioacoustic research: practical guide", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC11885706/" }, { "title": "NBM deposited archive", "url": "https://zenodo.org/records/17573913" } ], "searches": [ "bioacoustic bounding box annotation inter annotator IoU repeatability bird detection", "\"NBM\" \"duplicate\" birds dataset", "\"bioacoustic\" \"inter-annotator\" bounding boxes" ], "artifacts": [ { "title": "All inspected annotation variants and missing-label cases", "path": "evidence/nbm_duplicate_annotations.json" } ] }, { "id": "003", "title": "Does changing song-versus-call composition distort automated activity estimates?", "status": "Closed — pilot failed advancement gates", "question": "Within the same bird species and soundscape, does BirdNET recall differ between songs and contact calls enough to distort activity estimates when their mixture changes?", "rationale": "A detector can recognize a species well overall yet undersample one behavior. A useful contribution would quantify the within-species, within-recording effect across many species and determine how much duration/context explains it.", "minimal_test": "Use the new CEB soundscape annotations to count species with both songs and contact calls. Run a frozen BirdNET v2.4 model on a bounded stratified sample of eligible three-second windows, with no geographic prior. Compare per-species recall at fixed thresholds 0.1 and 0.5. Exclude windows containing both song and contact-call annotations of the focal species. Frozen implementation: SHA256 seed 20260919 assigns whole files to pilot (hash mod 3 == 0) or validation. Keep species with at least three paired files overall and at least one in each phase; at most three pilot files/species. Select one window per behavior/species/file using event-ID hashes. Exclude other annotated behaviors of the focal species from each window. No padding; source windows remain inside the three-minute file. Primary threshold 0.1; 0.5 is sensitivity only. These paired source files are not independent identified birds.", "novelty": "Broad call-type evaluation is not new: Weldy et al. (2025) compare sonotypes, and call-type classifiers exist. The narrower candidate is a comparative, same-recording audit of behavior-mixture bias and a practical calibration/abstention diagnostic. Need determine whether this distinction is substantive after the pilot. Clapp et al. (2026) explicitly identify time-varying recall as an open gap while studying precision; a 2022 researcher discussion already connects song/call mixtures to phenology. The broad problem is established. Our possible contribution is empirical estimation and validation of within-recording behavior-specific recall, not originating the concern.", "larger_test": "Advance only if at least ten species have usable paired data and the median species-level recall gap is at least 0.15 at a prespecified threshold. Larger validation must use disjoint recording groups, resample species and recordings rather than calls, examine duration/context and source effects, and seek external replication. Do not call a threshold-free score difference a recall effect.", "limitations": "No seasonal or population-abundance inference is available from these labels alone. CEB test data are a convenience sample; independence from original BirdNET training needs verification. Annotation type is expert-assigned behavior, not individual sex/age.", "results": [ "CEB v1 test labels contain 15,064 events in 147 files; 11,061 songs and 2,855 contact calls. No begging calls are in the soundscape test split, so a juvenile-begging hypothesis cannot be tested here.", "A newer v1.1 record (21821133) exists; audio archive checksum is unchanged, metadata checksums differ. Use the pinned newer metadata for analyses.", "After excluding mixed focal-species behaviors and requiring paired files in both phases, seven species remained (36 windows, 18 species-file pairs).", "At threshold 0.1, median species-level song-minus-contact-call recall was 0.00; at 0.5 it was also 0.00. Both the ≥10 species gate and ≥0.15 median-gap gate failed.", "Some species showed positive gaps and others zero or negative gaps. These very small post-hoc species subsets are not confirmed effects. Inference took 5.1 seconds after metadata preparation." ], "decision": "Do not advance to validation or claim a general song advantage. Held-out recordings have not been scored. A future substantially different hypothesis must be logged explicitly and cannot reuse these pilot results as confirmation.", "sources": [ { "title": "CEB v1 dataset and annotation schema", "url": "https://zenodo.org/records/20762099" }, { "title": "CEB v1.1 version", "url": "https://zenodo.org/records/21821133" }, { "title": "Weldy et al. (2025), simulated soundscapes and transfer learning", "url": "https://doi.org/10.1111/2041-210X.70089" }, { "title": "Adaptive loss balancing for species and call-type classification (2026 preprint)", "url": "https://arxiv.org/abs/2607.03304" }, { "title": "Clapp et al. (2026): acoustic phenology and unresolved recall shifts", "url": "https://doi.org/10.1002/ece3.73020" }, { "title": "2022 researcher discussion of song/call detection and phenology", "url": "https://bioacoustics.stackexchange.com/questions/438/how-do-you-deal-with-songs-vs-calls-when-assessing-birdnet-detection-rates" } ], "searches": [ "BirdNET accuracy \"begging\" calls song", "BirdNET vocalization type performance call song bias evaluation", "\"BirdNET\" \"vocalization type\" performance bias phenology", "\"Central European Birds\" vocalization types benchmark", "\"BirdNET\" \"songs and calls\" \"recall\"", "\"BirdNET\" \"song\" \"contact call\" performance", "\"Passive Acoustic Data as Phenological Distributions\" data call song" ], "artifacts": [ { "title": "Pilot summary by species", "path": "results/003_pilot_summary.csv" }, { "title": "All pilot windows and predictions", "path": "results/003_pilot_predictions.csv" }, { "title": "Sampling counts and unused validation availability", "path": "results/003_sampling_counts.csv" }, { "title": "Analysis script", "path": "scripts/ceb_behavior_pilot.py" } ] }, { "id": "004", "title": "Do bird mitochondrial coding annotations reproduce their deposited proteins?", "status": "Closed — control passes; closely covered by prior work", "question": "Can a small annotation audit distinguish legitimate mitochondrial recoding from incorrect coding annotations in public bird genomes?", "rationale": "Bird mitochondrial ND3 sometimes contains an extra nucleotide handled by recoding. Incorrect treatment can create misleading proteins in comparative analyses. A useful project would need a specific new failure mode beyond established mitogenome quality audits.", "minimal_test": "Download a well-characterized chicken mitogenome from ENA. Parse CDS features, translation tables and exceptions; compare extracted coding sequences to deposited protein translations. Distinguish incomplete terminal stops and programmed frameshifts from defects.", "novelty": "Andreu-Sánchez et al. (2021) analyzed tens of thousands of ND3 sequences, including recoding-site evolution and annotation issues. Sangster & Luksenburg (2021) systematically investigated avian mitogenome errors and downstream reuse. This proposed general audit lacks a sufficiently distinct question.", "results": [ "All 13 chicken CDS features reproduce deposited translations after allowing mitochondrial initiation codons to encode methionine. No internal stop discrepancy was found.", "The 1990 X52392 record is a historical control, not a representative survey or ground truth for avian recoding. A consistent translation does not establish a correct underlying sequence." ], "decision": "Stop this candidate after the control and first novelty check; do not perform a larger scan merely to rediscover known problems.", "sources": [ { "title": "ENA chicken mitochondrial genome X52392", "url": "https://www.ebi.ac.uk/ena/browser/view/X52392" }, { "title": "Sangster & Luksenburg (2021), problematic avian mitogenomes", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC8462277/" }, { "title": "Multiple origins of a frameshift insertion (2021)", "url": "https://doi.org/10.1093/gigascience/giaa161" } ], "searches": [ "avian mitochondrial genome ND3 frameshift annotation errors 2024 2025 2026", "\"Sharp Increase of Problematic Mitogenomes\" data github" ], "artifacts": [ { "title": "Chicken CDS translation control", "path": "results/004_chicken_translation_control.json" } ] }, { "id": "005", "title": "Can seasonal species filters censor early migrants?", "status": "Closed — direct prior study found", "question": "Does a date-dependent species allowlist introduce an artificial detection boundary for early or late migrating birds even when the acoustic evidence is unchanged?", "rationale": "A seasonal prior can improve identification, but phenology studies target deviations from expected timing. A substantive contribution would quantify documented true-positive losses and resulting timing bias, beyond the familiar warning that priors can miss rare birds.", "minimal_test": "Run the official BirdNET v2.4 geographic model at a fixed European location for all 48 modeled weeks. Record default-threshold allowlist crossings for common migratory birds and compare with the year-round mode. This is a counterfactual model diagnostic, not evidence that a bird was present on any particular date.", "novelty": "A June 2026 preprint by Pérez-Granados et al. directly compares no filter, spatial filter and spatiotemporal filter across worldwide annotated soundscapes. Its discussion specifically warns about missing early and late migrants. This materially overlaps the question.", "larger_test": "Only advance if meaningful week-dependent exclusions occur and the exact research question is not already answered. Larger validation needs dated, geolocated, independently annotated recordings and must distinguish removing false positives from losing genuine early/late detections. Model-only calendar curves cannot establish real ecological bias.", "results": [ "Official v2.4-V2 geographic model at Riga (56.95 N, 24.10 E), threshold 0.03: Willow Warbler accepted in 28 of 48 modeled weeks, Common Cuckoo in 26, Barn Swallow in 31, Spotted Flycatcher in 25; robin, blackbird and chaffinch in all 48.", "This establishes date-dependent exclusion only; no observation dates or real phenological losses were inferred." ], "decision": "Reject the broad seasonal-censoring study as insufficiently new; no expensive soundscape analysis.", "sources": [ { "title": "BirdNET Analyzer v1.5.1 model implementation", "url": "https://github.com/birdnet-team/BirdNET-Analyzer/tree/v1.5.1" }, { "title": "Clapp et al. (2026) acoustic phenology", "url": "https://doi.org/10.1002/ece3.73020" }, { "title": "Pérez-Granados et al. (2026), spatial and temporal filter assessment [preprint]", "url": "https://doi.org/10.64898/2026.06.02.729608" } ], "searches": [ "BirdNET seasonal geographic filter early arrival phenology bias", "BirdNET range filter climate change migration detection prior circularity", "\"BirdNET\" \"week\" \"bias\" phenology" ], "artifacts": [ { "title": "All 48-week outputs for eight species at Riga", "path": "results/005_riga_seasonal_filter.csv" } ] }, { "id": "006", "title": "Is a year-round species list guaranteed to contain every weekly list?", "status": "Closed — related behavior already documented; small pilot anomaly", "question": "Does the BirdNET year-round filter obey the expected nesting of all weekly allowlists?", "rationale": "A year-round filter is trained to predict peak weekly occurrence, yet unconstrained neural predictions might violate that relationship. This would be a sharper question than the seasonal-filter warning.", "minimal_test": "Compare official week=-1 outputs with the maximum of weeks 1–48 at five fixed locations, using the default 0.03 cutoff.", "results": [ "Riga, central Germany and Ithaca had no weekly-only species. An equatorial East African point had one (Wailing Cisticola), and an Australian point had one (Australasian Figbird).", "Year-round lists also contained species absent from every weekly list; the discrepancy is not simply the annual average of weekly scores." ], "novelty": "BirdNET-Analyzer issue #211 already reports year-round lists differing from the union of weekly lists. The maintainer explains that the -1 mode is trained separately against maximum weekly checklist frequencies. Our reverse-direction exceptions are a narrow consequence of the same unconstrained approximation; no material ecological impact has been established.", "decision": "Retain the reproducible observation but do not call it a new research contribution or enlarge it solely to accumulate discrepancies.", "limitations": "Five model coordinates, no independently confirmed bird occurrences, and two small cutoff crossings. No evidence of missed real recordings or precision improvement from a proposed fix.", "sources": [ { "title": "Official discussion and explanation of year-round filter training", "url": "https://github.com/birdnet-team/BirdNET-Analyzer/issues/211" }, { "title": "Official geographic model documentation", "url": "https://github.com/birdnet-team/BirdNET-Analyzer/discussions/234" } ], "searches": [ "\"BirdNET\" \"year-round\" \"maximum\"", "\"BirdNET\" \"year-round\" \"missing\" species", "\"BirdNET\" \"species lists\" \"nested\"", "GitHub issues search: repo:birdnet-team/BirdNET-Analyzer \"year round\"" ], "artifacts": [ { "title": "Five-location model comparison", "path": "results/006_yearround_nesting_pilot.json" }, { "title": "Maintainer explanation, archived via public API", "path": "evidence/birdnet_issues_211_comments.json" } ] }, { "id": "007", "title": "Do plant promoter benchmarks separate independent DNA sequences?", "status": "Closed — exact overlap too small to support lead", "question": "Do public plant promoter benchmarks contain exact or reverse-complement-identical sequences across train/test splits, or duplicated parent constructs that permit target memorization?", "rationale": "Plant design increasingly depends on sequence-to-function models. A concrete, consequential benchmark flaw could be valuable to document, but generic concerns about genomic train/test leakage are established and do not themselves constitute novelty.", "minimal_test": "Download the public PDLLMs core-promoter classification splits and the PGB tobacco-leaf promoter-strength splits. Audit exact sequences, reverse complements, duplicated labels and available sequence IDs. If there is a material overlap, test a training-only lookup baseline before any expensive model training.", "novelty": "Initial source reading: AgroNT uses held-out chromosomes for several genomic tasks and adopts the published Jores promoter-strength splits. Respect each benchmark’s intended generalization target; related sequences alone are not proof of inappropriate leakage. Generic homology-induced evaluation leakage is studied directly by Rafi et al. (2025 preprint). The original Jores study explicitly used random promoter holdouts; finding related promoters would not alone contradict that design.", "larger_test": "Advance only if an overlap or shortcut has a measurable predictive consequence and contradicts a stated evaluation target; require new holdouts or group-aware splits and re-check whether the specific issue has already been reported.", "results": [ "PDLLMs: 66,560 training, 8,320 validation and 8,320 test sequences. No exact or reverse-complement training/test overlap. One sequence links training/validation and a different one validation/test.", "PGB leaf promoter strength: 58,179 training, 6,825 validation and 7,154 test sequences. Two reverse-complement-canonical matches between training/test (0.028% of test).", "Corrected FASTA parsing before interpretation: numeric expression label is the field after the final |, not the whole identifier." ], "decision": "Close this narrow exact-overlap hypothesis. No substantive overall evaluation effect is established. Homology and nearest-neighbor leakage require a different analysis; absence of exact copies does not exclude them.", "sources": [ { "title": "PDLLMs source and tasks", "url": "https://github.com/zhangtaolab/Plant_DNA_LLMs" }, { "title": "PDLLMs core promoter dataset", "url": "https://huggingface.co/datasets/zhangtaolab/plant-multi-species-core-promoters" }, { "title": "Plant Genomic Benchmark", "url": "https://huggingface.co/datasets/InstaDeepAI/plant-genomic-benchmark" }, { "title": "AgroNT paper", "url": "https://doi.org/10.1038/s42003-024-06465-2" }, { "title": "Homology leakage and genome-trained models (2025 preprint)", "url": "https://doi.org/10.1101/2025.01.22.634321" }, { "title": "Original Jores promoter study", "url": "https://doi.org/10.1038/s41477-021-00932-y" } ], "searches": [ "plant genomic benchmark sequence data leakage AgroNT PlantCaduceus 2026", "\"AgroNT\" \"leakage\"", "\"plant-genomic-benchmark\" \"duplicate\"", "\"plant-multi-species-core-promoters\" leakage", "\"PDLLMs\" leakage duplicate benchmark" ], "limitations": "Reverse-complement identity does not guarantee the same directional promoter function. Exact overlap counts alone are not a measure of model optimism.", "artifacts": [ { "title": "Split audit results", "path": "results/007_promoter_split_audit.json" }, { "title": "Audit code", "path": "scripts/promoter_split_audit.py" } ] }, { "id": "008", "title": "Does arbitrary window alignment change recognition of a complete short bird call?", "status": "Closed — established overlap/context problem", "question": "How sensitive are BirdNET scores to temporal translation of a short vocalization that remains fully inside its three-second input?", "rationale": "If small changes in the analysis grid alter complete-event detection, comparing counts from differently aligned files can add avoidable uncertainty. A new contribution would need a measured practical consequence and a validated correction beyond standard overlapping windows.", "minimal_test": "Reuse the previously frozen pilot sample, selecting only events at most 1.2 seconds long. Circularly shift each identical three-second waveform by −0.6, −0.3, 0, +0.3 and +0.6 seconds. The centered target event remains intact. Also shift real source-window starts by those offsets. Compare threshold-crossing fractions at 0.1 (primary) and 0.5 (secondary). Advance to novelty review if at least 20% of eligible events cross 0.1 across shifts.", "limitations": "Circular shifts can cut background events and create a boundary seam. Real source shifts change contextual audio. These are diagnostics, not yet a pure causal attribution or field error rate; pilot selection is inherited from an earlier question.", "results": [ "18 short events from six species and 13 pilot files were scored at five temporal offsets.", "Circular translation: 5/18 events crossed score 0.1 and 3/18 crossed 0.5; median score range 0.071. Real source-window translation: 3/18 crossed 0.1 and 4/18 crossed 0.5; median range 0.063.", "The circular diagnostic passed the 20% gate, while the natural-window diagnostic did not. No population error rate or effect on ecological conclusions is established." ], "decision": "Do not enlarge this generic translation diagnostic. The known overlap/consensus approaches already address the practical concern, and our pilot cannot isolate a new failure mechanism. Preserve scores and move to a different question.", "sources": [ { "title": "CEB v1.1", "url": "https://zenodo.org/records/21821133" }, { "title": "BirdNET frozen implementation", "url": "https://github.com/birdnet-team/BirdNET-Analyzer/tree/v1.5.1" }, { "title": "Chirpity author describes boundary artifacts and context consensus (2024)", "url": "https://github.com/Mattk70/Chirpity-Electron/discussions/136" }, { "title": "Global BirdNET assessment discusses tested overlap effects", "url": "https://doi.org/10.1016/j.ecolind.2025.114550" } ], "searches": [ "BirdNET \"time shift\" prediction", "BirdNET \"window\" \"position\" detection confidence overlap", "bird sound classification temporal translation invariance window alignment" ], "novelty": "Prior BirdNET/Chirpity implementations already address segmentation-dependent false positives through overlapping-window consensus. Translation sensitivity of CNNs and bird-audio window-size effects are established. Need a distinct practical contribution before larger validation. The 2024 Chirpity discussion describes the boundary-confusion mechanism and an implemented adjacent-window rule; the global BirdNET assessment cites tests of overlap and vocalization duration. Our observations are too close to these established concerns.", "artifacts": [ { "title": "Per-window perturbation scores", "path": "results/008_alignment_predictions.csv" }, { "title": "Pilot summary", "path": "results/008_alignment_summary.json" }, { "title": "Pilot script", "path": "scripts/window_alignment_pilot.py" } ] }, { "id": "009", "title": "How reliable are the expression targets in plant promoter benchmarks?", "status": "Closed broad noise question — follow-up on coding barcodes", "question": "Do low-precision expression measurements change evaluation or design rankings in reused plant promoter benchmarks?", "rationale": "Repeated floating-point target values in the downloaded promoter data motivate checking their experimental origin. Count-based reporter measurements have unequal precision; a useful study would connect that uncertainty to design decisions or model evaluation, beyond merely observing measurement noise.", "minimal_test": "Read original measurement-processing code and compare benchmark labels with source measurements and biological replicates. First determine whether repeated labels reflect low counts, normalization or something else; do not infer low coverage from ties alone. Quantify replicate disagreement across a fixed Arabidopsis leaf pilot before selecting a larger test.", "results": [ "Arabidopsis leaf pilot: 15,469 promoters with two replicates; Pearson r=0.884 and median absolute difference 0.411 log2 units.", "Promoters with a minimum of one surviving barcode had median replicate disagreement 0.609 log2 units; those with at least ten had 0.333. These strata also differ biologically and are not a randomized coverage experiment.", "The full leaf benchmark-source condition has 72,221 promoter measurements: 4,981 represented by one surviving replicate and 17,363 by a minimum of one surviving barcode." ], "decision": "Do not claim generic measurement-noise discovery. The source construct places a 12-base random barcode in the first four codons after the initiation codon, motivating a separate specific hypothesis about positional barcode sequence effects.", "limitations": "Noise-aware MPRA analysis already exists. Novelty would require a distinct demonstrated consequence in plant design benchmarks. Expression differences between leaf and protoplast assays confound species, tissue and assay system.", "sources": [ { "title": "Original experimental study", "url": "https://doi.org/10.1038/s41477-021-00932-y" }, { "title": "Source data and analysis code", "url": "https://github.com/tobjores/Synthetic-Promoter-Designs-Enabled-by-a-Comprehensive-Analysis-of-Plant-Core-Promoters/" }, { "title": "Sequence-based correction of barcode bias, MTSA (2021)", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC8415370/" }, { "title": "Statistical considerations for MPRA analysis (2020)", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC7722129/" } ], "searches": [ "\"plant\" \"promoter\" \"benchmark\" \"measurement noise\"", "\"Jores\" \"promoter\" \"low\" \"counts\"" ], "novelty": "Heteroscedastic MPRA measurements, count-ratio bias and barcode-related uncertainty are established. MTSA (Lee et al., 2021) directly models sequence-specific barcode effects. The source study already reports replicate correlations. No general novelty claim from re-quantifying these facts.", "artifacts": [ { "title": "Replicate pilot by barcode support", "path": "results/009_replicate_pilot.csv" }, { "title": "Pilot summary", "path": "results/009_replicate_summary.json" } ] }, { "id": "010", "title": "Do short coding barcodes systematically alter plant promoter readouts?", "status": "Closed — below frozen pilot thresholds", "question": "In Plant STARR-seq, does the identity and position of bases in a four-codon barcode predict RNA/DNA enrichment among barcodes attached to the same promoter?", "rationale": "The barcode follows the start codon rather than lying in a 3′ UTR. A position-specific, reproducible effect could implicate assay architecture and guide barcode design. We cannot infer a translation or RNA-decay mechanism solely from count associations.", "minimal_test": "Use Arabidopsis library, tobacco leaf, enhancer present, dark, replicate 1. Reproduce original RNA/DNA count cutoff ≥5 and WT/full-length mapping filter. Fit within-promoter effects of one-hot bases at all 12 barcode positions, holding out complete promoter groups by fixed SHA256 hash. Compare held-out residual prediction with zero. Advance if held-out R² is at least 0.01 or the fitted first-barcode-base contrast spans at least 0.1 log2 units; validate in an independent biological replicate and another assay system if novelty survives.", "novelty": "General sequence-specific barcode bias and correction are known from MTSA. The candidate is the specific positional behavior of short translated barcodes in plant assays and its reproducible practical impact. This distinction must be tested against the full prior literature, not inferred from the different organism alone.", "results": [ "214,433 barcodes belonging to 12,082 promoters passed the pilot filters; 2,409 whole promoters formed the held-out diagnostic set.", "Held-out within-promoter R² was 0.00954, below the frozen 0.01 threshold. The A/C/G contrast at the first barcode base spanned 0.0256 log2 units, below the 0.1 threshold.", "Only four first-position T barcodes survived. This base is disallowed by the intended VNN barcode design; its estimated coefficient was not used for the advancement gate." ], "limitations": "Original count truncation, promoter sequence variants, barcode misassignment and sequence-dependent sequencing/RT efficiencies are alternative explanations. Shared barcodes across replicates are not independent randomized interventions. Source code clarifies that the metadata mutations field lists intentional restriction-site-removal edits, while variant=WT identifies a match to the designed construct; nonempty mutations is not evidence of sequencing error.", "decision": "Do not enlarge the study by adjusting the gate after seeing a near miss. Small sequence effects may exist, but this pilot does not establish a practically consequential new bias or a translation mechanism.", "sources": [ { "title": "Plant STARR-seq construct and measurement methods", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC10246763/" }, { "title": "Closest barcode-correction prior, MTSA", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC8415370/" } ], "searches": [ "plant STARR seq barcode sequence bias promoter Jores", "\"barcode\" \"sequence\" \"bias\" MPRA RNA stability" ], "artifacts": [ { "title": "Pilot metrics", "path": "results/010_At_leaf_rep1_metrics.json" }, { "title": "Position coefficients", "path": "results/010_At_leaf_rep1_coefficients.csv" }, { "title": "Reproducible pilot", "path": "scripts/coding_barcode_pilot.py" } ] }, { "id": "011", "title": "Are bird-audio predictions invariant to computational batching?", "status": "Closed — batching invariance passes", "question": "Does an identical waveform receive materially different BirdNET scores when batched with silence, a different recording, or an amplified recording?", "rationale": "Batching should alter throughput, not the meaning of individual samples. A failure could reveal an actionable normalization issue rather than a generic ecological limitation.", "minimal_test": "Check dynamic-batch support in the frozen official TFLite model. Compare identical waveform logits alone and in batches of two with zero, independent and 10×-amplitude distractors. A material failure requires a score difference greater than 0.01 or a change at score threshold 0.1, beyond numerical roundoff.", "results": [ "All 12 solo-versus-batch comparisons (four recordings × three distractors) had exactly zero score difference across all 6,522 labels. No threshold crossings." ], "decision": "Reject the batch-dependence hypothesis for this model/backend. No reason for a larger experiment.", "limitations": "This tests one frozen acoustic model and inference backend. It is not a comparison of model versions or a biological effect.", "sources": [ { "title": "Official frozen BirdNET source", "url": "https://github.com/birdnet-team/BirdNET-Analyzer/tree/v1.5.1" } ], "searches": [], "artifacts": [ { "title": "All model comparisons", "path": "results/011_batch_invariance.json" }, { "title": "Reproducible invariant test", "path": "scripts/batch_invariance_pilot.py" } ] }, { "id": "012", "title": "Does barcode count filtering make promoter ranks depend on sequencing depth?", "status": "Executed — validated resource-specific robustness result", "question": "When the same RNA count table is computationally thinned, does the published per-barcode RNA≥5 filter and median-ratio estimator systematically change promoter rankings?", "rationale": "This is a specific ascertainment question prompted by source-code inspection, distinct from ordinary replicate noise. Low-RNA barcodes disappear as depth falls; a retained-only median may shift as the surviving barcode set changes. A useful contribution requires a material and avoidable effect on current plant-design benchmark targets.", "minimal_test": "Use Arabidopsis leaf replicate 1 raw counts. Keep the original WT/full-length associations and original DNA≥5 rule. Compare full counts with seeded binomial RNA thinning to 50% and 25%; recompute the original median of retained log2 RNA/DNA ratios and correct the known dilution. Contrast with a fixed-barcode pooled-count ratio retaining RNA zeros. Analyze common promoters with ≥10 DNA-supported barcodes, report retention and all rank shifts. Advance only if median absolute activity shift exceeds 0.25 log2 units or rank correlation drops below 0.95 at 25% depth.", "novelty": "mpralm (2019) derives lower bias for aggregate ratios than mean log ratios; a 2025 human-assay comparison recommends DNA-based filtering. These establish the statistical rationale. Searches so far did not locate a direct depth-intervention audit of the Jores/PGB plant promoter targets. This is provisional novelty of an empirical benchmark consequence, not a new estimator.", "results": [ "Pilot includes 5,853 promoters with at least ten DNA-supported barcodes. At full depth, 5,822 have a retained-median estimate; 5,125 remain at quarter depth.", "At quarter RNA depth, retained-median ranking correlation is 0.766 and median absolute activity shift is 0.402 log2 units after correcting known dilution. 17.8% of retained promoters shift by more than one log2 unit.", "Fixed-barcode pooled counts: quarter-depth rank correlation 0.993 and median absolute shift 0.080 log2 units across all 5,853 promoters. These are own-baseline comparisons; a larger test must compare methods on identical promoter sets.", "Reconstruction audit: both maize libraries match the deposited values for every measured promoter. Arabidopsis replicate 1 differs for one promoter, replicate 2 for 17. All 18 per-replicate discrepancies disappear to numerical precision when Arabidopsis RNA counts are reduced modulo 1000. This is a separate provenance lead; see 013.", "Prespecified validation passes: At replicate 2 quarter-depth Spearman 0.8648 (retained median) versus 0.9950 (all pooled); Zm replicate 1 0.9379 versus 0.9971. Zm replicate 2 independently gives 0.9360 versus 0.9966. These are five-thinning-seed means on identical method comparison sets.", "Biological replicate agreement on common promoters with >=10 DNA-supported barcodes in both samples improves from Spearman 0.9550 to 0.9847 in At (5,700 promoters), and 0.9688 to 0.9893 in Zm (8,869). This is two replicate pairs, not thousands of independent biological replicates." ], "decision": "Completed full execution as study 014, using all twelve model-relevant libraries and six replicate pairs; the result supports a computational resource note, with provisional novelty and explicit limits.", "limitations": "Computational thinning only probes read-sampling depth, not transfection noise or between-library reproducibility. Fixed observed counts are not biological ground truth.", "sources": [ { "title": "Original barcode count processing", "url": "https://github.com/tobjores/Synthetic-Promoter-Designs-Enabled-by-a-Comprehensive-Analysis-of-Plant-Core-Promoters/blob/main/analysis/read%2Bprocess_barcode_counts.R" }, { "title": "MPRA statistical considerations", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC7722129/" }, { "title": "mpralm: aggregation and ratio-estimator bias (2019)", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC6417258/" }, { "title": "Human MPRA comparison and DNA-based filtering (2025)", "url": "https://doi.org/10.1186/s13059-025-03828-8" }, { "title": "MPRAsnakeflow: prior count/downsampling analysis (2025)", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC12621732/" } ], "searches": [ "\"MPRA\" \"filtering\" \"RNA\" \"bias\" threshold", "\"Jores\" \"downsampling\" promoter", "\"STARR-seq\" \"barcode\" \"censoring\"", "\"promoter\" \"sequencing depth\" \"median\" barcode", "\"Jores\" \"RNA\" \"filtering\" \"bias\"", "\"Jores\" \"sequencing depth\" promoter", "\"plant\" \"promoter\" \"barcode\" \"downsampling\"", "\"MPRA\" \"RNA\" \"filtering\" \"censoring\"", "\"MPRAsnakeflow\" \"downsampling\"", "\"Jores\" \"mpralm\"" ], "larger_test": "Before inspecting further outcomes: reconstruct normalized original labels exactly using barcode controls and two-replicate means; verify against deposited source data. Validate with At leaf replicate 2 and Zm leaf replicate 1, with Zm leaf replicate 2 for complete benchmark reproduction. Use five seeded thinnings at 50% and 25% RNA depth. Compare retained median, all-barcode median with 0.5 pseudocount, retained pooled counts and all-barcode pooled counts. Primary identical promoter set: >=10 DNA-supported barcodes, full-depth observed in all methods, and retained in the thin original estimator; separately report dropout. Preserve source cutoff DNA>=5; sensitivity DNA>=20. Advancement requires original-estimator quarter-depth Spearman<0.95 in both new validation libraries and pooled-all improvement >=0.05; test pooled-retained to isolate censorship from aggregation. Evaluate actual independent-replicate agreement before recommending any corrected label set. Seek published-model consequences using original held-out predictions. Clarification before validation outcomes: exact historical reconstruction is established by attempt 013; depth tests use robust whitespace counts and independently reconstructed corrected values. PGB targets are a distinct snapshot and cannot yet be called corrected by these values.", "artifacts": [ { "title": "Pilot depth results", "path": "results/012_depth_summary.json" }, { "title": "Per-promoter pilot estimates", "path": "results/012_depth_estimates.csv" }, { "title": "Pilot script", "path": "scripts/promoter_depth_pilot.py" } ], "second_novelty": "MPRAsnakeflow (2025) already evaluates count/barcode downsampling and replicate agreement in human libraries. mpralm (2019) already explains advantages of pooling counts. A general downsampling tool or new pooling estimator would not be novel. The remaining contribution is a reproducible, resource-specific audit of plant promoter target robustness, coupled to verified historical parser effects and separated target snapshots. Searches did not locate that applied result; novelty remains provisional pending expert review." }, { "id": "013", "title": "Did historical fixed-width count parsing alter inherited plant promoter labels?", "status": "Verified archive discrepancy — correctly parsed values already public", "question": "Did the original readr fixed-width parser truncate high barcode counts, and are the resulting altered promoter values present in later plant-model benchmarks?", "rationale": "Exact reconstruction exposed a deterministic discrepancy: 1137→137 for one RNA count reproduces an archived promoter value. The old parser inferred field boundaries from the first 1000 rows. This can be tested against the full raw files and archived downstream artifacts.", "minimal_test": "Compare robust whitespace count parsing to the fixed-width boundaries inferred from the first 1000 rows, using the original readr v1.4.0 source as reference. Confirm that all initially mismatched Arabidopsis values are reproduced without per-gene fitting; use maize libraries as negative controls.", "results": [ "At leaf replicate 1: 1/15,767 reconstructed promoter values differs from the archive; At leaf replicate 2: 17/16,484 differ. Maize leaf replicates: zero discrepancies among 29,964 and 29,073 measurements.", "Applying RNA count modulo 1000 in both Arabidopsis libraries reproduces every archived promoter value within 1.8×10⁻¹⁵. The largest corrected per-replicate difference is 3.142 log2 units.", "The official readr v1.4.0 source confirms read_table() used fwf_empty() over the first 1000 rows, followed by a fixed-width tokenizer. Current readr uses different behavior; this is a historical compatibility/provenance issue, not an assertion about current readr.", "Full native-library audit: all 869,289 deposited per-replicate measurements exactly match legacy parsing inferred from raw file layout, with zero unmatched values. The 58 input files include 35 with truncation, 4,521 altered barcode-file records and 11,894,000 lost count units.", "Correct whitespace parsing changes 60,051 of 448,345 averaged measurements. Most changes are small common normalization offsets from three affected control medians. Only 53 averaged values change by >1 log2 unit; maximum 4.265. These are measurement-condition records, not independent plants.", "Independent historical R 4.0.3/readr 1.4.0 execution agrees with all 58 Python audit summaries (row counts, altered counts and lost reads), with zero parser-problem reports. Base R scan() is the robust reference. An initial historical read_table2 reference stopped early on one file (544,573/557,172 rows), so that incomplete attempt was rejected; cause of that separate behavior was not investigated.", "All 147,966 PGB promoter sequences and targets exactly match the original CNN exports. The later deposited RData instead differs from all 147,842 matched PGB values; 124 PGB identifiers are absent from that snapshot. Differences are mostly small (leaf median absolute ~0.072, protoplast ~0.038 log2), but 74 exceed one log2 unit. Snapshot differences are not established errors, and are not the parser corrections.", "The parsing source code is byte-identical between the January 2021 initial commit and July 2025 deposit. CNN files existed in January 2021; RData was added in July 2025. Original CNN-label generation still needs reconstruction. No benchmark correction files have been issued.", "Second provenance check found the original author’s public 2023-08-28 attachment. All 869,289 per-replicate values and the entire missingness pattern exactly match robust whitespace reconstruction (max error 2.7e-15), independently validating it. Therefore corrected original-estimator values are not new. The later RData deposit contains the legacy-parser fingerprint; no claim that the author had never produced correct values is justified." ], "novelty": "The generic readr fixed-width limitation is documented. Novelty would be a previously unreported, verified impact on this experimental resource and its downstream model targets, with explicit corrected records. No claim of a new parser bug or broad invalidity of the biological study.", "larger_test": "Before scope outcomes: audit every native-promoter leaf/protoplast count file from the pinned source repository, infer widths from file layout rather than selecting moduli from outcomes, reconstruct all deposited per-replicate values with legacy-compatible parsing, and compute corrected labels with whitespace parsing. Verify inherited values in PGB splits and original CNN inputs. Quantify affected records, practical size, training/test membership and model-metric consequences. Create an executable historical-R reproduction or clearly delimit any remaining emulator uncertainty. Recheck closest prior work after results.", "decision": "Close as a standalone discovery claim: retain the verified provenance audit and attachment comparison as support for the measurement-robustness study. Do not report PGB parser corruption or claim first correction of the source values.", "limitations": "Exact downstream agreement strongly supports the parser explanation but is not a record of the authors’ actual execution environment. A small number of changed labels may have negligible aggregate model impact; do not inflate severity.", "sources": [ { "title": "Source pipeline at pinned historical repository", "url": "https://github.com/tobjores/Synthetic-Promoter-Designs-Enabled-by-a-Comprehensive-Analysis-of-Plant-Core-Promoters/blob/ace4ead59de364922fccdecd331554ccf0ac522b/analysis/read%2Bprocess_barcode_counts.R" }, { "title": "readr v1.4.0 read_table implementation", "url": "https://github.com/tidyverse/readr/blob/v1.4.0/R/read_table.R" }, { "title": "PGB downstream benchmark", "url": "https://huggingface.co/datasets/InstaDeepAI/plant-genomic-benchmark" }, { "title": "Public 2023 source-author replicate attachment", "url": "https://github.com/tobjores/Synthetic-Promoter-Designs-Enabled-by-a-Comprehensive-Analysis-of-Plant-Core-Promoters/issues/1" } ], "searches": [ "readr read_table truncates first digit counts fixed width", "read_table readr digits cut off leading whitespace bug", "\"Jores\" \"read_table\"", "\"Jores\" \"readr\" truncation", "\"plant genomic benchmark\" \"parsing\"", "\"promoter\" \"read_table\" \"bug\"", "\"Jores\" \"promoter\" \"labels\" benchmark discrepancy", "\"Synthetic promoter\" \"readr\"", "\"plant genomic benchmark\" promoter preprocessing Jores" ], "artifacts": [ { "title": "Full audit summary", "path": "results/013_scope_summary.json" }, { "title": "Actual historical R parser verification", "path": "results/013_historical_r_parser.csv" }, { "title": "Per-library exact reconstruction", "path": "results/013_library_reconstruction.csv" }, { "title": "Benchmark target provenance", "path": "results/013_benchmark_provenance_summary.json" }, { "title": "Affected averaged source values", "path": "results/013_changed_average_labels.csv" }, { "title": "Author attachment independently matches every reconstructed value", "path": "results/013_author_attachment_verification.json" } ], "second_novelty": "The original repository has one public issue, requesting replicate data, whose author response supplies the correctly parsed measurements in 2023. PGB discussions concern unrelated viewer/gene-expression labels. A newly described discrepancy between snapshots may be useful provenance documentation, but producing the corrected values does not satisfy novelty on its own." }, { "id": "014", "title": "Completed study: RNA-count filtering destabilizes plant promoter ranks", "status": "Executed — figures, data, reproducible workflow and research note", "question": "Does the validated depth effect persist across all three promoter-origin species and both assay hosts, and does it affect evaluation of frozen published predictions?", "rationale": "This executes the lead from 012. The applied contribution is measured resource-specific robustness, not a new estimator or biological regulatory mechanism.", "minimal_test": "See 012 for pilot and validation gates. No new thresholds were selected for this extension.", "novelty": "Pooling, MPRA downsampling and processing-bias studies precede this work. Targeted searches found no report of the exact Jores-resource comparison. The original author already supplied correct original-estimator values in 2023, so the parser correction is excluded from novelty.", "larger_test": "The extension protocol recorded under 012 was executed unchanged for Sb leaf replicates and all six protoplast libraries. Five seeds at 50%/25% RNA depth; DNA cutoffs 5/20; all four estimator variants, shared cohorts and dropout. Frozen CNN test predictions were mapped only where species/target matches uniquely identified a gene.", "results": [ "All twelve libraries show improved quarter-depth stability with all-barcode pooling: mean Spearman range 0.9901–0.9974, versus 0.7681–0.9564 for the RNA-filtered median. All methods and both DNA thresholds are reported.", "All six biological RNA replicate-pair comparisons improve with all-barcode pooling, from Spearman range 0.9212–0.9814 to 0.9534–0.9931. At protoplast replicates share their DNA input; promoter counts are not biological replicate counts.", "Frozen CNN sensitivity on 1,860 eligible leaf test promoters: source median full/quarter Spearman 0.8185/0.7789; all pooled 0.8225/0.8231. On 2,311 protoplast promoters: 0.8248/0.8024 versus 0.8211/0.8197. No retraining or model-family ranking claim.", "All 147,966 PGB targets match original CNN exports; generation of those targets from raw counts remains unresolved. This does not invalidate the independently reconstructed measurements or support replacing PGB labels.", "Scientific controls verify synthetic fixed-width truncation, analytical estimator calculations, RNA-zero retention, and permutation invariance. Historical R independently verifies all 58 parser-audit summaries; the public 2023 author attachment independently matches all 869,289 robustly reconstructed measurements." ], "second_novelty": "Reviewed mpralm (2019), MPRAsnakeflow (2025), human MPRA processing comparisons (2025), the source study and its full public issue history, plus PGB discussions and targeted Jores/promoter/filtering/downsampling searches. No exact prior applied result found. Novelty remains provisional until expert review; no guarantee of publication.", "limitations": "One experimental resource; two biological replicates per library/host combination; RNA-only thinning; high-coverage selected cohorts; pooled weighting is not proven biological truth; frozen-CNN subset evaluation; unresolved CNN-export provenance. Monte Carlo seeds are not biological replication.", "decision": "The local computational study is executed and yields a useful original empirical result under the searched literature scope. Package it for review as a short computational resource/methods note. Do not submit or contact authors without user instruction.", "artifacts": [ { "title": "Readable standalone research note", "path": "study.html" }, { "title": "Editable research-note text", "path": "study-draft.txt" }, { "title": "Reproduction guide", "path": "REPRODUCE.md" }, { "title": "All depth outcomes", "path": "results/014_full_depth_metrics.csv" }, { "title": "All replicate comparisons", "path": "results/014_independent_replicates.csv" }, { "title": "Published prediction sensitivity", "path": "results/014_frozen_cnn_metrics.csv" } ], "sources": [ { "title": "Original plant promoter study", "url": "https://doi.org/10.1038/s41477-021-00932-y" }, { "title": "Prior aggregation analysis: mpralm", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC6417258/" }, { "title": "Prior downsampling workflow: MPRAsnakeflow", "url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC12621732/" }, { "title": "Human MPRA processing comparisons", "url": "https://doi.org/10.1186/s13059-025-03828-8" }, { "title": "2023 source-author measurement attachment", "url": "https://github.com/tobjores/Synthetic-Promoter-Designs-Enabled-by-a-Comprehensive-Analysis-of-Plant-Core-Promoters/issues/1" } ], "searches": [ "\"plant promoter\" \"RNA filtering\" sequencing", "\"Jores\" \"barcode\" \"pooling\"", "\"plant promoter\" \"downsampling\" \"median\"", "\"Jores\" \"replicate\" \"reanalysis\"", "\"Jores\" \"promoter\" \"correction\" data counts", "\"Synthetic promoter designs\" \"error\" data" ] }, { "id": "015", "title": "Can automated bird detection manufacture apparent avoidance between species?", "status": "Closed — insufficient isolated, detectable source events", "question": "If the occurrence of two bird vocalizations is experimentally independent, does a fixed-window audio classifier create a negative association between their detections, including when their calls do not overlap in time?", "rationale": "Species co-occurrence and temporal partitioning are ecological quantities. Dependence of one species detection on another species vocalizing could manufacture evidence of competition or avoidance. A controlled mixture establishes presence without requiring inferred field interactions.", "minimal_test": "Select a fixed, deterministic sample of annotated short single-species events from the cached CEB test recordings, with no other annotated bird in the source excerpt. Require baseline target scores >=0.5 and use at most two excerpts per species from distinct source files. Combine pairs at matched event RMS, with simultaneous and non-overlapping event timing and matched attenuation controls. No clipping; hold baseline gain and placement explicit. Primary advancement gate: in non-overlapping mixtures at least 20% of baseline-detectable target appearances fall below 0.5, across at least four source species and two distinct recording pairs per affected species. Also report continuous score changes, simultaneous-mixture results and failed eligibility. Pilot file selection must not be reused as held-out validation.", "novelty": "Candidate generation found broad prior work on soundscape interference and synthetic multi-species mixing. The specific novelty question, after the minimal test, is whether controlled independent vocalizations produce spurious ecological association even without acoustic event overlap, and whether an explicit calibration can correct it.", "decision": "Close this dataset-specific pilot without relaxing selection or confidence gates. Continue to another biological question.", "limitations": "Annotation-based isolation does not guarantee absence of every unannotated sound. Audio mixing is an intervention on detectability, not evidence of real interactions among wild birds.", "sources": [ { "title": "Soundscape composition and bird-classification errors (2023)", "url": "https://doi.org/10.1016/j.ecoinf.2023.102065" }, { "title": "Synthetic multi-species mixing for domain shift", "url": "https://www.dfki.de/en/web/research/projects-and-publications/publication/17345" } ], "searches": [ "bird vocalization classifier synthetic mixtures co-occurrence bias", "bird bioacoustics classifier mixed species false positive co occurrence networks BirdNET" ], "results": [ "The fixed sampler found 37 isolated short events. Only two events from one species met the predeclared baseline >=0.5 at both time positions, so there were no eligible heterospecific pairs.", "The eligibility gate failed before a mixture effect could be measured. This is a dataset/model limitation, not evidence that the proposed ecological bias is absent." ], "artifacts": [ { "title": "Pilot summary", "path": "round-002/results/015_summary.json" }, { "title": "All candidate baseline scores", "path": "round-002/results/015_all_baselines.csv" }, { "title": "Pilot implementation", "path": "round-002/scripts/mixture_pilot.py" } ] }, { "id": "016", "title": "Does strand-specific G-rich promoter architecture predict host portability?", "status": "Closed — predeclared motif-carrier gate failed", "question": "Do canonical G-quadruplex-like promoter motifs show a strand-specific association with changes in activity between tobacco leaves and maize protoplasts, after accounting for ordinary sequence composition?", "rationale": "A sequence feature associated with host portability could help design promoters that transfer between assay systems. G-rich secondary-structure motifs are plausible regulatory features, but their apparent effects can simply reflect GC or ordinary transcription-factor motifs. The pilot tests a narrow residual association and does not presume DNA folding.", "minimal_test": "Use maize-origin native promoter sequences and paired host activity estimates, requiring >=10 DNA-supported barcodes in both biological replicates of both hosts. Scan a fixed canonical G3 motif (four runs of >=3 G separated by 1–7 bases) and its reverse-complement C-rich counterpart. Before outcome testing require >=50 promoters for each orientation. Fit log2(leaf activity)-log2(protoplast activity) on motif indicators, mononucleotide and dinucleotide composition, regional GC content, quadratic/cubic overall GC and a canonical core TATA indicator. Primary contrast: G-motif coefficient minus C-motif coefficient; advance only if absolute contrast >=0.25 log2 and HC3 robust |t|>=3, with consistent sign using both original-median and pooled activity estimates. Hold sorghum and Arabidopsis outcomes out of this pilot.", "novelty": "Plant G4 sequence surveys and regulatory mechanisms already exist. A new contribution would require a specific, reproducible host-portability relationship that survives composition controls and independent validation, not simply enrichment of G-rich sequence in promoters.", "decision": "Close without lowering the minimum carrier count or inspecting outcome contrasts. Continue discovery.", "limitations": "Motif matching does not demonstrate G4 formation, and transient reporter assays are not native genomic expression. This is exploratory mechanistic prioritization until replicated and independently validated.", "sources": [ { "title": "Plant G4 sequence survey (2016)", "url": "https://www.nature.com/articles/srep28211" }, { "title": "Original plant core promoter experiments", "url": "https://doi.org/10.1038/s41477-021-00932-y" } ], "searches": [ "plant core promoter G quadruplex Jores promoter strength" ], "results": [ "Of 8,796 eligible maize-origin promoters, 48 carried the fixed G-rich motif and 302 carried its C-rich counterpart. The predeclared minimum was 50 for each orientation, so the activity association was not tested.", "A pandas mixed-column-index join error was fixed before obtaining any result; no analytical choices changed." ], "artifacts": [ { "title": "Pilot summary", "path": "round-002/results/016_g4_summary.json" }, { "title": "Sequence features", "path": "round-002/results/016_maize_sequence_features.csv" }, { "title": "Pilot implementation", "path": "round-002/scripts/g4_portability_pilot.py" } ] }, { "id": "017", "title": "Are the two ends of a plant gene functionally coordinated?", "status": "Closed — no meaningful coordination in the pilot", "question": "Do separately measured native core-promoter and terminator activities covary for the same gene beyond shared sequence composition, and is this relationship consistent across assay hosts?", "rationale": "A natural gene pairs its promoter and terminator, but synthetic designs often choose these parts independently. A reproducible residual association could test proposed coordination between transcription initiation and termination; it would not establish that a particular pair physically interacts.", "minimal_test": "Pilot only Arabidopsis chromosome 1 genes. Join native 170-base terminator activities from Gorjifard et al. 2024 to the 2021 promoter sequences and original-median / pooled promoter estimates, requiring >=10 DNA-supported promoter barcodes in both replicates of both hosts. Use gene-level averages when there are multiple terminator entries. Compute Spearman correlation and partial rank correlation after adjusting both activities for mono- and dinucleotide composition of both promoter and terminator, regional GC and overall GC squared/cubed. Advance only with >=500 matched genes and a positive partial correlation >=0.15 in both hosts using both promoter estimators. Hold other Arabidopsis chromosomes and maize out of this pilot.", "novelty": "Gene harmony is a prior hypothesis. An author dissertation also compares promoter, terminator and enhancer strengths with gene expression; this is a potential direct overlap to inspect before advancing. Merely joining two tables is not novel.", "decision": "The frozen effect gate failed. Do not inspect held-out chromosomes or maize for this hypothesis.", "limitations": "Different reporter assays measure each end independently; these data cannot establish promoter–terminator interaction or causal evolutionary coadaptation. Chromosomes are partitions, not independent species.", "sources": [ { "title": "2024 terminator experiment", "url": "https://doi.org/10.1038/s41467-024-50174-7" }, { "title": "Author code and data", "url": "https://github.com/lampoona/Terminators-Plant-STARR-seq" }, { "title": "Potential prior overlap: 2023 dissertation", "url": "https://digital.lib.washington.edu/bitstreams/4d733549-d704-41f0-b694-f1ed407ed110/download" } ], "searches": [ "plant promoters terminators strengths same gene correlation Jores terminators 2022", "\"Arabidopsis and maize terminator strength\" \"promoter\" correlation" ], "results": [ "977 Arabidopsis chromosome-1 genes passed the matching and coverage rules. Composition-adjusted promoter/terminator correlations ranged from 0.0066 to 0.0244 across both assay hosts and both promoter estimators, below the predeclared +0.15 threshold.", "This does not test physical promoter–terminator interactions, and it does not refute all forms of transcription/termination coordination." ], "artifacts": [ { "title": "Pilot summary", "path": "round-002/results/017_summary.json" }, { "title": "Matched chromosome-1 activities", "path": "round-002/results/017_chr1_matched_activities.csv" }, { "title": "Pilot implementation", "path": "round-002/scripts/gene_harmony_pilot.py" }, { "title": "Pinned input provenance", "path": "round-002/evidence/017_terminators_downloads.json" } ] }, { "id": "018", "title": "Bird co-detection bias using single-species passages", "status": "Validation effect replicated; diversity gate failed", "question": "Can two separately detectable bird vocalizations suppress one another in an automated detector even when they occupy disjoint parts of its input window?", "rationale": "Entry 015 required exactly one annotation per excerpt. That excludes a bird producing several notes, although the excerpt can still contain only one species. This follow-up changes source eligibility to single-species passages and retains the original causal comparison and score/effect gates.", "minimal_test": "Use only the entry-015 pilot recording partition (SHA256 of 015:20260919:filepath, first 8 hex digits modulo 3 equals 0), keeping the other recordings uninspected for validation. For each annotated event center, take 1.2 seconds and require every intersecting valid annotation to belong to the target species, allowing multiple same-species events and excerpts of longer vocalizations. Select at most 8 candidate passages per species from distinct files, and 240 total, deterministically before model scores. Scale excerpts to a common RMS with a single clipping-safe scale. Require target score >=0.5 at both time positions, at least two source files per species; retain at most two passages per species. Compare exact-component baselines to non-overlapping mixtures in both orders and simultaneous mixtures. Advance if >=20% of non-overlapping target appearances lose detection at 0.5, across >=4 species with >=2 distinct recording pairs per affected species. The baseline and advancement thresholds are unchanged from entry 015.", "novelty": "Noise and soundscape interference are known. If the pilot succeeds, investigate prior demonstrations of spurious ecological association from temporal-context competition, and existing mitigations, before validating.", "decision": "Do not call this a completed study. Record the shortfall and pursue a separately specified focal-recording extension (entry019), retaining the existing negative feasibility outcomes.", "limitations": "Single-species annotation does not prove acoustic purity. Model conditioning on an eligible detectable subset limits population generalization; any result describes this controlled counterfactual experiment.", "sources": [ { "title": "Prior soundscape interference study", "url": "https://doi.org/10.1016/j.ecoinf.2023.102065" }, { "title": "Synthetic multi-species augmentation", "url": "https://www.dfki.de/en/web/research/projects-and-publications/publication/17345" } ], "searches": [ "\"BirdNET\" \"co-occurrence\" bias mixtures" ], "results": [ "98 source candidates yielded 18 baseline-eligible passages from 9 species. Non-overlapping mixtures lost 53.6% and 57.5% of target detections in the two orders; simultaneous mixtures lost 63.9%.", "Nearest prior studies establish noise/overlap interference and source-separation methods. No exact disjoint-time controlled association study was found; this remains provisional.", "Held-out recordings yielded only 16 eligible passages from four species, below the frozen >=8 species and >=24 passage gate. Detection losses were 42.0% and 44.7% in the two non-overlapping orders, and 62.2% in simultaneous mixtures. The effect criterion passed but the study advancement gate did not." ], "artifacts": [ { "title": "Pilot summary", "path": "round-002/results/018_summary.json" }, { "title": "All mixture outcomes", "path": "round-002/results/018_mixture_results.csv" }, { "title": "First novelty review", "path": "round-002/evidence/018_novelty_review_1.json" }, { "title": "Frozen validation protocol", "path": "round-002/evidence/018_validation_protocol.json" }, { "title": "Pilot implementation", "path": "round-002/scripts/passage_mixture_pilot.py" }, { "title": "Validation summary", "path": "round-002/results/018_validation_summary.json" }, { "title": "Validation implementation", "path": "round-002/scripts/bird_mixture_validation.py" }, { "title": "Output-path correction and recovery record", "path": "round-002/evidence/018_output_path_correction.json" } ] }, { "id": "019", "title": "Independent focal-recording extension of the bird mixture experiment", "status": "Larger test and robustness controls passed; completed study in entry 020", "question": "Does the disjoint-time detection loss reproduce with adequate species coverage in separately sourced focal recordings?", "rationale": "The entry018 held-out effect replicated but its eight-species diversity gate failed. A separately specified source dataset can test transfer beyond the four eligible soundscape species without relaxing the score or loss thresholds. This is an extension of the same hypothesis, not an unrelated discovery.", "minimal_test": "Use the pinned CEB train_xenocanto recordings, independently annotated from the soundscape test recordings. For every target event, require all annotations intersecting a centered 1.2-second passage to be the target species, including blocking unknown-species annotations. Exclude passages starting before zero or extending beyond the actual recording. Before model outcomes, retain at most12 distinct-recording candidates/species and360 candidates total using SHA256 rank 019:20260919:event_id. Require target >=0.5 at both positions. Keep up to4 eligible clips/species with at least3 distinct files and at most16 species by fixed hash. Minimal eligibility gate: >=8 species,>=24 clips. Mixture effect gate unchanged: >=20% losses in nonoverlap at0.5,>=4 species affected in>=2 independent recording pairs. No further selection expansion after outcomes.", "novelty": "Entry018 first novelty review applies to the same narrow claim; additional literature review required after this source extension. Synthetic mixing, source separation and environmental interference are known.", "decision": "The frozen source-diversity and effect gates passed. Controls and the secondary natural-window check are executed; the complete note, limitations and reproducibility verification are recorded in entry 020.", "limitations": "Focal Xeno-Canto clips may have appeared in BirdNET training; this is not an unseen-classification-accuracy benchmark. The manipulated counterfactual remains defined, but ecological prevalence and field interaction claims are excluded. Recordists and per-file licenses must be retained.", "sources": [ { "title": "CEB pinned dataset", "url": "https://doi.org/10.5281/zenodo.21821133" }, { "title": "BirdNET v2.4 model source", "url": "https://github.com/birdnet-team/BirdNET-Analyzer/tree/v1.5.1" } ], "searches": [], "results": [ "A fixed sample of360 candidate passages yielded56 baseline-eligible passages from16 species and56 distinct recordings, passing the frozen source-diversity gate.", "The source archive MD5 matched the pinned Zenodo record and all2,210 extracted recordings are checksummed. Long source recordings are read as bounded excerpts with resampling margins.", "Non-overlapping focal mixtures lost54.46% of5872 target appearances (source-file bootstrap95% interval48.96–59.55%); all16 species were affected. Exact independent-presence enumeration produced detected phi=-0.472 while true phi=0. Same-species non-overlapping mixtures had zero losses." ], "artifacts": [ { "title": "Eligibility outcome", "path": "round-002/results/019_focal_eligibility.json" }, { "title": "Predeclared protocol", "path": "round-002/evidence/019_protocol.json" }, { "title": "Predeclared robustness controls", "path": "round-002/evidence/019_robustness_plan.json" }, { "title": "Audio manifest", "path": "round-002/evidence/019_audio_manifest.json" }, { "title": "Selected recordings with author/license attribution", "path": "round-002/results/019_focal_selected_events.csv" }, { "title": "Focal validation implementation", "path": "round-002/scripts/focal_mixture_validation.py" }, { "title": "Focal mixture summary", "path": "round-002/results/019_focal_summary.json" }, { "title": "Association and uncertainty analysis", "path": "round-002/results/019_focal_analysis.json" }, { "title": "Second novelty review", "path": "round-002/evidence/019_novelty_review_2.json" }, { "title": "Secondary natural-window plan", "path": "round-002/evidence/019_natural_ablation_plan.json" } ], "second_novelty": "A second review after the focal result found no directly equivalent combination of disjoint-time counterfactuals, matched normalization and independent-presence association enumeration. General interference, source separation and detection-aware ecological models are prior work. Novelty remains provisional." }, { "id": "020", "title": "Completed study 02: disjoint-time interference in bird detections", "status": "Completed — executed and reproduced; novelty provisional", "question": "Can an otherwise recognizable bird passage lose detection because another species calls elsewhere within the same three-second window, and can that generate an artificial negative co-detection association?", "rationale": "This tests a specific failure of the observation process that could mislead short-window bird-interaction analyses. The outcome is a version-specific, reproducible stress test, not a new ecological mechanism or a new classifier.", "minimal_test": "Entry 018 produced 18 passages from nine species and more than 50% loss in both non-overlapping orders. Entry 015 had failed isolated-note eligibility. The separately held-out soundscape test replicated the effect but failed its frozen diversity gate; that failure remains explicit.", "novelty": "First review covered soundscape interference, overlapping mixtures, source separation, multi-label learning and imperfect detection. These broad ideas are established and are not claimed as new.", "larger_test": "Entry 019 prospectively specified a separate CEB focal-recording source. A fixed 360-candidate screen yielded 56 eligible passages, 56 files and 16 species, passing the source-diversity gate. Both orders, simultaneous mixtures, same-species mixtures, common-normalization intervention, continuous ambient controls and exact four-state presence enumeration were executed. A later, prospectively specified secondary check evaluated 364 natural field windows.", "second_novelty": "The second documented review, followed by final title and software-discussion checks, found no directly equivalent empirical combination of disjoint-time bird mixtures, identical target components, controlled normalization and explicit independent-presence association. This supports a plausible original contribution; it is not proof of first-ever priority or journal acceptance.", "results": [ "Focal non-overlapping mixtures: 3,198 / 5,872 otherwise detectable target appearances lost detection at 0.5 (54.46%; source-file bootstrap 95% interval 48.96–59.55%). All 16 species were affected. These appearances reuse 56 recordings and are not 5,872 independent birds.", "The two temporal orders lost 54.63% and 54.29%; equal-species averaging gave 53.13%. Same-species non-overlap controls lost 0 / 288 appearances.", "Common waveform normalization preserved exact target samples after normalization and still gave 57.11% conditional loss among 1,196 eligible appearances. The patched graph reproduced original baseline logits exactly and mixture probabilities within 7.2e-8.", "With three continuous natural backgrounds, loss was 41.09% among 2,139 eligible appearances (2,400 tested). Background-specific results were 40.0–42.1%.", "Natural field windows: 37 / 140 individually eligible appearances lost detection (26.43%; file-bootstrap interval 18.32–35.04%). The matched-normalization result was 25.36%. Across all 728 annotated appearances, 37 threshold losses and 29 gains occurred. This is a secondary context-ablation experiment, not field recall.", "Exactly independent calling states generated detected phi = -0.472 while true phi = 0; 90.8% of 2,936 pair-orders showed negative detected association. A toy aggregation analysis shows the effect weakens substantially with sparse calling and longer presence bins.", "The complete isolated CPU rerun passed: all 23 result CSV tables were byte-identical, and all 10 scientific JSON summaries matched (runtime fields excluded). The report, four vector figure pairs, full tables, credits, input hashes and portable workflow are complete.", "Preservation verified: all 125 protected first-study artifacts, all original 14 journal entries and the original 51,161,677-byte plant-study archive remain unchanged.", "Telegram API confirmed successful delivery of the authorized completion message, including the study link and qualified novelty statement." ], "limitations": "One pinned BirdNET v2.4 model, a selected European species set and a fixed primary threshold. Conditioning on detectability limits generalization. Xeno-Canto inputs may overlap training. Natural context removal also removes background, and reuses the soundscape dataset. No claim of real bird avoidance, wild-population error prevalence, validity of a deployable correction or failure of all occupancy studies. Novelty needs expert scrutiny.", "decision": "The second study is complete, reproduced, publicly readable, committed and pushed. The user-requested Telegram completion notification was delivered successfully. Stop this discovery loop on the executed, useful result; novelty remains provisional pending expert review. No manuscript was submitted and no author was contacted.", "artifacts": [ { "title": "Read the complete second study", "path": "round-002/study.html" }, { "title": "Download the reproduction package", "path": "round-002/results/019_reproducibility.tar.gz" }, { "title": "All focal mixture outcomes", "path": "round-002/results/019_focal_mixture_results.csv" }, { "title": "Primary effect, uncertainty and exact association", "path": "round-002/results/019_focal_analysis.json" }, { "title": "Common-normalization control", "path": "round-002/results/019_focal_normalization_summary.json" }, { "title": "Continuous-background control", "path": "round-002/results/019_ambient_summary.json" }, { "title": "Natural-window results, including gains", "path": "round-002/results/019_natural_context_summary.json" }, { "title": "Calling-rate and aggregation sensitivity", "path": "round-002/results/019_focal_prevalence_aggregation.csv" }, { "title": "All source recording credits and licenses", "path": "round-002/results/019_focal_selected_events.csv" }, { "title": "Exact model and dataset inputs", "path": "round-002/evidence/019_study_input_manifest.json" }, { "title": "Final novelty review", "path": "round-002/evidence/019_novelty_review_2.json" }, { "title": "Full isolated-rerun and preservation verification", "path": "round-002/evidence/019_completion_verification.json" }, { "title": "Archive checksum and member inventory", "path": "round-002/results/019_package_manifest.json" }, { "title": "Authorized Telegram completion receipt", "path": "round-002/evidence/020_telegram_notification.json" } ], "sources": [ { "title": "CEB pinned dataset", "url": "https://doi.org/10.5281/zenodo.21821133" }, { "title": "BirdNET v2.4 model source", "url": "https://github.com/birdnet-team/BirdNET-Analyzer/tree/v1.5.1" } ], "searches": [ "\"BirdNET\" \"disjoint\" calls", "\"bird\" \"non-overlapping\" \"false negatives\"", "\"bird\" \"temporal context\" \"suppression\" classifier", "\"CEB\" \"Central European Birds\" classification mixtures", "bird acoustic classifier nonoverlapping vocalizations false negatives context pooling", "\"BirdNET\" \"independent\" \"co-occurrence\" detection", "\"sound event detection\" \"context bias\"" ] }, { "id": "021", "title": "Can five retained transcribed bases introduce a reporter start-codon effect?", "status": "Closed — cross-host effect gate failed", "question": "Do ATG start codons within the five native bases retained after the annotated transcription start predict reduced reporter RNA enrichment beyond ordinary promoter sequence composition?", "rationale": "The 2021 plant core-promoter assay uses positions -165 to +5, followed by a common histone 5-prime UTR. The authors deliberately excluded longer native UTRs because they can affect RNA post-transcriptionally. A residual ATG in the retained five bases could potentially open a competing reading frame in the common reporter context. This is a hypothesis about an assay-specific sequence effect, not a claim of a new translation mechanism.", "minimal_test": "Use Arabidopsis chromosome 1 only, native promoters present in both assay hosts and both replicates, with at least 10 DNA-eligible barcodes per measurement at the established DNA cutoff 5. Require at least 50 last-five-base ATG carriers and at least 500 total promoters. Model log2 enrichment separately in leaf and maize protoplast, using sequence composition, GC polynomial, positional GC, a fixed TATA indicator and mono-nucleotide identity at the five retained bases. The ATG indicator tests a sequence interaction beyond these single-base terms; also report an upstream ATG count in the 30 bases before the retained segment. Test both the retained-median and pooled-count estimators. Advance only if all four ATG effects are <= -0.5 log2 units with HC3 |t| >=3. Do not inspect other chromosomes or promoter species for outcomes unless this gate passes.", "novelty": "After the minimal test, review upstream-ORF and reporter-assay work plus reuse of this exact dataset. Upstream translation and effects of native UTRs are already established. Source-method inspection is required to determine whether an ATG could be transcribed in the actual construct.", "limitations": "Annotated TSSs are not measured reporter initiation sites. A terminal-ATG association might reflect initiator sequence preferences rather than translation, and cannot establish a uORF mechanism without independent evidence. This is an intentionally stringent feasibility/effect pilot.", "decision": "Frozen effect gate failed; do not examine validation chromosomes or species.", "sources": [ { "title": "Jores et al. 2021 source study", "url": "https://doi.org/10.1038/s41477-021-00932-y" }, { "title": "Author-hosted full paper and assay design", "url": "https://queitschlab.gs.washington.edu/pdf/Jores_et_al_2021.pdf" } ], "searches": [ "Jores 2021 plant core promoters upstream AUG reporter transcription start site STARR seq 170 30", "plant core promoter MPRA upstream open reading frame ATG confounding reporter RNA" ], "artifacts": [ { "title": "Frozen protocol", "path": "round-003/evidence/021_protocol.json" }, { "title": "Pilot result", "path": "round-003/results/021_summary.json" }, { "title": "Pilot implementation", "path": "round-003/scripts/start_codon_pilot.py" }, { "title": "Frozen plan in pushed commit 808166f", "path": "https://github.com/faso/thecabin-server/commit/808166f" } ], "results": [ "The chromosome-1 pilot had 1442 eligible promoters and 302 terminal-ATG carriers.", "Leaf effects were -0.387 and -0.439 log2 units under retained-median and pooled estimators (HC3 t=-4.18 and -3.90). Maize-protoplast effects were -0.094 and -0.082 (t=-0.91 and -0.75).", "The predeclared minimum -0.5 effect in all four analyses was not met. Other chromosomes and promoter species remain unexamined for this hypothesis. A smaller leaf association is not evidence of the proposed translation mechanism." ] }, { "id": "022", "title": "Do cryptic splice-donor motifs predict post-transcriptional loss in intronic reporters?", "status": "Frozen minimal test", "question": "In a plant MPRA where all fragments are placed inside a reporter intron, do strong sense-strand splice-donor motifs predict lower total-versus-newly-labeled RNA abundance than reverse-complement motifs?", "rationale": "Voichek et al. 2024 measured both total mRNA and mRNA labeled during a 20-minute 5-EU pulse for the same approximately 12,000 reporter fragments. Correct splicing removes each variable insert, making fragment-dependent post-transcriptional differences an interesting possibility. An internal GT[AG]AGT donor could compete with the canonical donor; its reverse-complement sequence is a specificity control. Splicing effects are established biology, and the proposed assay mechanism requires independent support.", "minimal_test": "Use only Arabidopsis chromosome-1 origin fragments from Supplementary Table 5, including all three native positions, with finite paired total/5-EU values and exactly 160 A/C/G/T bases. Primary outcome is the published total-RNA minus newly-labeled-RNA log2 value. Regress on sense donor count GT[AG]AGT and reverse-complement count ACT[CT]AC, mono/dinucleotide composition, GC squared/cubed, fixed origin-position categories, and the known YVGATCBR regulatory motif count. Report the sense-minus-antisense coefficient contrast with standard errors clustered by source gene; a gene-cluster bootstrap will be used in validation if needed. Require >=500 fragments, >=50 sense-motif carriers and >=50 reverse-motif carriers; advance only for contrast <=-0.30 log2 and t<=-3. Other chromosomes and other MPRA outcomes remain unexamined until this gate passes.", "novelty": "After a passing pilot, search for cryptic-splicing effects in plant reporter libraries, previous reanalysis of this dataset and transcriptome evidence for insert retention. Known intron-mediated transcription enhancement and GATC effects are not new.", "limitations": "A total/newly-labeled ratio is not a calibrated RNA half-life. The short labeling pulse, capture efficiency and transient expression may matter. A motif association does not prove altered splicing; follow-up RNA sequencing would be needed to support that mechanism.", "decision": "Run the frozen paired-RNA pilot; do not change motif, threshold or sampling scope after outcomes.", "sources": [ { "title": "Voichek et al. 2024, Nature Genetics", "url": "https://doi.org/10.1038/s41588-024-01907-3" }, { "title": "Published supplementary data", "url": "https://media.springernature.com/original/springer-static/esm/art%3A10.1038%2Fs41588-024-01907-3/MediaObjects/41588_2024_1907_MOESM4_ESM.xlsx" } ], "searches": [ "\"Widespread position-dependent transcriptional regulatory sequences in plants\" data github", "\"Widespread position-dependent\" splicing motifs intron" ], "artifacts": [ { "title": "Frozen protocol", "path": "round-003/evidence/022_protocol.json" }, { "title": "Pinned source hashes", "path": "round-003/evidence/022_source_downloads.json" } ] } ], "featured": { "title": "Read the completed plant promoter robustness study", "path": "study.html" } }