Commit Graph

206 Commits (6ffcaa0afe0ee1a49c9e5d704cc361b0c1b03c72)

Author SHA1 Message Date
depristo cf910d9cc2 misc. useful updates to python library
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3683 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-30 16:33:32 +00:00
weisburd e7939f7036 Fixed error message
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3653 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-28 14:50:28 +00:00
weisburd 1cb8f51f8c Fixed -t arg
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3634 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-24 23:44:10 +00:00
weisburd 3cd0570c1e Now can run with multiple processes, multiple threads, or both
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3633 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-24 23:25:01 +00:00
weisburd dae3ce2c0f changed log dir
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3632 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-24 23:08:13 +00:00
weisburd fea8054e9e Updated long name for -l to --run-locally
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3631 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-24 22:26:45 +00:00
weisburd 72e669538e Updated arg description for -s
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3629 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-24 22:04:01 +00:00
weisburd cef12b45e1 Fixed typo
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3561 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-15 21:17:14 +00:00
weisburd c0370f4d0a Added both inclusive and exclusive filters
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3538 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-11 18:40:41 +00:00
weisburd d1a4c4f0d3 Added -w filter option allowing user to specify chromosomes to be skipped.
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3531 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-10 20:58:25 +00:00
weisburd 6fd2d39a7d Modified run_locally mode to use os.system(..) instead of popen
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3515 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-09 17:10:03 +00:00
weisburd a3ccf49f5b Write error to stderr
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3514 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-09 17:09:10 +00:00
weisburd 2b31975cb4 Added more options for coordinate systems - now you can add 1 to either the start coordinates, the end coordinates, or both
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3508 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-08 22:49:19 +00:00
weisburd 410afcdf2c Added parallelization options - when running locally, multiple processes can be spawned, or a -nt arg can be specified to run each TranscriptToInfo instance multi-threaded
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3507 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-08 22:48:07 +00:00
weisburd 92c72d3361 Added back lines that update the *big-table-header.txt file before using it
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3506 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-08 22:45:41 +00:00
weisburd 3c24223d02 Script for concatenating 2 AnnotatorInputTables, and writing the result to standard out. Merge-sorts the 2 tables while concatenating them
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3505 348d0f76-0448-11de-a6fe-93d51630548a
2010-06-08 22:44:16 +00:00
depristo f32a32269c minor change for eric
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3418 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-21 20:13:36 +00:00
depristo d1098fa77b Removing unnecessary dependences that were causing problems for Sendu
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3410 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-21 13:07:41 +00:00
depristo 886e9c1297 Now can take a VCF file as input
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3378 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-18 17:06:12 +00:00
depristo 2a212c497f minor improvements and bug fixes
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3376 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-18 15:54:42 +00:00
depristo 43544cfdf9 remote control of IGV to jump to any number of loci in a file and screenshot the locus to a file
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3375 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-18 12:59:36 +00:00
weisburd 04e14ef85a Refactored so it could be used for knownGene and CCDS as well as refGene
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3373 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-18 02:45:11 +00:00
depristo 2a803e9044 simple tool that takes two dbSNP files and subsets the seconds to only include rsID SNPs present in the first. Used to make b129 against b37 by subsetting b131/b37 vs. b129/b36
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3352 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-12 13:39:09 +00:00
depristo d3c33d4b3f more powerful management routines for my pipeline
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3351 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-12 13:37:39 +00:00
weisburd f120a00433 Fixed bug so that the strand, alternate, and reference columns are now moved correctly
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3342 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-10 17:59:39 +00:00
depristo d6b036cdab Minor improvements to simple python code
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3330 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-07 21:34:46 +00:00
chartl d5b675b3e6 Added - Q&D script to gather verbose bed files to a VCF.
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3294 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-05 02:49:16 +00:00
weisburd a462b5e1e7 Changed a default path
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3291 348d0f76-0448-11de-a6fe-93d51630548a
2010-05-03 17:07:21 +00:00
weisburd 28f746b76a Added option to generate UCSC or NCBI sequence
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3283 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-30 17:26:00 +00:00
weisburd c214056d88 Script for concatenating results of GenerateTranscriptToInfo.py into one big file
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3279 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-30 15:47:08 +00:00
weisburd 0069cb426d Script for spawning LSF jobs that run the TranscriptToInfo.java walker on each of the 50 contigs.
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3277 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-30 15:27:52 +00:00
weisburd ba7fe7c4e1 Renamed
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3276 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-30 15:25:07 +00:00
weisburd 4937295a0b Renamed
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3275 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-30 15:24:56 +00:00
depristo bf3dbd8401 some useful routines for working with project processing. madPipeline contains a bunch of useful routines for building pipelines that I finally put into one file. Let's just say that I'm really looking forward to the new pipeline system...
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3260 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-26 12:34:04 +00:00
weisburd c7b4f78316 Added -m arg
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3233 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-21 22:38:47 +00:00
depristo 7902db616e Marginally more useful output
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3201 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-20 14:45:14 +00:00
chartl 4eba9bffc1 Grabs average SNP calls, mismatch rate, aligned reads, and other important lane metrics from a SQUID export and summarizes them across multiple margins (lane numbers, flowcells, samples, libraries)
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3193 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-17 03:09:05 +00:00
depristo 7973806716 interim update
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3173 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-15 14:25:02 +00:00
chartl 2e4377b1cf Awesome: JobDispatcher can now dispatch jobs by gene from a target .design file found in /seq/references.
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3170 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-14 18:17:41 +00:00
weisburd 04c22a6640 Added handling of UCSC and NCBI reference sequences
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3165 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-14 14:40:31 +00:00
weisburd 2183f10a1d Script for validating and converting text files into the tabular format required for GenomicAnnotator -B inputs
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3156 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-13 13:35:10 +00:00
chartl fab31e1d53 Check in so I don't lose this code -- spawning of jobs by genes
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3137 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-08 16:18:40 +00:00
chartl 27fb6f7594 Make sure to convert non-integer chromosomes (M,X,Y) back from their corresponding integer representations (0,23,24) when writing in .bed format
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3119 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-03 20:01:21 +00:00
chartl 687fd477ff Just some code I want to freeze. If you ever need to estimate the % of bases covered by exon, given an interval list, give it to getTargetedGenes. Not the best name for this function, but I don't expect anyone to use it but me.
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3111 348d0f76-0448-11de-a6fe-93d51630548a
2010-04-01 20:21:50 +00:00
chartl ac9c335cd2 This is a python job dispatcher I've been using, which builds on Mark's FarmJob utility, and an example script of how I'm using it. Basically I wrote it to smartly break up analysis over an interval list, givin a maximum number of bases per job, a list of available queues, and a limit on each queue. It handles going over these limits in three ways:
1) [default]: Fail
  - No jobs are actually spawned

2) Space
  - User provides a string of the form A:B:C where A is the number of days to wait before scheduling jobs over
    the queue limits; B the number of hours, C the number of minutes. Exceeding the queue limits again will
    increment the space by another A:B:C

3) Stop-Resume
 - Spawns the maximum number of jobs, and writes a file describing the next job, and a hash code of the remaining jobs.
   The next time the script is run, it spawns the next set of jobs starting with what's written in the file. If the 
   hash code (and thus the command string) changes between runs, the dispatcher fails-fast.

The base job dispatcher class is also capable of dealing with dependencies if it is used correctly.



git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3102 348d0f76-0448-11de-a6fe-93d51630548a
2010-03-31 19:53:13 +00:00
chartl dc802aa26f Moved CoverageStatistics to core. This will be (soon) renamed DepthOfCoverage; so please use CoverageStatistics
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3090 348d0f76-0448-11de-a6fe-93d51630548a
2010-03-29 13:32:00 +00:00
depristo 08d9ae403d better farm commands, and simple utility to convert ucsc repeat masks to interval lists
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3040 348d0f76-0448-11de-a6fe-93d51630548a
2010-03-19 13:11:06 +00:00
chartl 4bdc3b2784 automatic generation of individual and individual set import files
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3001 348d0f76-0448-11de-a6fe-93d51630548a
2010-03-15 10:36:33 +00:00
chartl d9b12b468f Adding default filter info
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@3000 348d0f76-0448-11de-a6fe-93d51630548a
2010-03-15 10:05:46 +00:00
andrewk 196bca6819 Script to split concordance files into their constituent sets and calculate summary stats from a concordance file - SNPs called and number in dbSNP
git-svn-id: file:///humgen/gsa-scr1/gsa-engineering/svn_contents/trunk@2992 348d0f76-0448-11de-a6fe-93d51630548a
2010-03-12 22:20:44 +00:00