Transcript
GRIMOIRE OF GEOLOGICAL COMPUTING Observatory Manual and Site Notes Windows 10 edition G. L. Jacquier
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 2
About the Grimoire of Geological Computing MASTER THE CORE OF EARTH SCIENCE: PREPARE THE PAST AND PREDICT THE FUTURE
Grimoire of Geological Computing is the most complete, up-to-date book on the core technology for geo-information. You’ll learn everything you need to know about preparing earth models in spreadsheets, Microsoft Access, Geographical Information Systems (GIS), and Google Earth the latest, more powerful improvement in understanding nature. But it doesn’t stop there. You also get practical instruction in complementary productivity software such as Microsoft Word, Publisher and Outlook, and Thomson EndNote; along with the Glossary of Geological Computing that makes it easier to understand the brochures for the purchases you will make. Tying it all together is the author’s expert guidance on planning, developing and maintaining effective, accessible geoscience computer systems.
Coverage includes
buying a computer Planning and developing public, personal and intranet sites including images for maps creating consistent publication styles using batch scripts including multimedia creating dynamic databases validating field data creating coherent, easily maintainable computer systems making your databases searchable accommodating users who don’t have geological knowledge Creating an earth model Extending the earth model with an ore system
Learn to develop effective earth science databases – then make the leap to building effective computer systems. Tackle advanced topics like MS Excel formula, and Jscript. This book is filled with check lists
Geocomputing Management 3 and instructions that will help you make the transition to the latest technologies. The book includes the ‘Glossary of Geological Computing’ explaining software, hardware and management information systems and more. Visit www.grantjacquier.info for more information
About the author: Grant Jacquier, the editor of the “Computers in Geology” newsletter, the specialist how-to journal of tips on geological computing, has been president of the Australian Geoscience Information Association and founder of the Specialist Group in Computing of the Geological Society of Australia. After twenty years contracting he is now concentrating on science stationery.
What the critics are saying: … I’ve just skimmed through it. It reminded me of War and Peace – long book, lots of characters, good plot, historical context and lots of gems just waiting to be plucked. (PM, 2011 Windows 7 edition) USER LEVEL ALL LEVELS BOOK TYPE HOW-TO/REFERENCE CATEGORY GEOSCIENCE INFORMATION
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 4
Topics Grimoire of Geological Computing ............................................................................................ 1
About the Grimoire of Geological Computing .......................................................................................... 2 Topics....................................................................................................................................................... 4 Publication notes...................................................................................................................................... 6
Preface ...................................................................................................................................... 8 Contents .................................................................................................................................. 17
Facts and checklists............................................................................................................................... 23 Examples and graphs ............................................................................................................................ 26 Commands and algorithms .................................................................................................................... 27
Chapter 1 – INTRODUCTION ................................................................................................. 30
Why does the computing have to be geological? .................................................................................. 31 What are the key concepts? .................................................................................................................. 46 Why not just buy the software? ............................................................................................................. 64 How do I not waste my money? ............................................................................................................ 66 When can I use a computer safely? ...................................................................................................... 76 Where can I get a computer? ................................................................................................................ 94
Chapter 2 – METHOD: an ore system acts on an earth model............................................. 105
Choosing the equipment for a natural history computer system ......................................................... 106 Identifying the processes used in a computer system for natural history ........................................... 143 Using an ore system on an earth model .............................................................................................. 199 The reference & indexing phase .......................................................................................................... 206 The loading data & verification phase ................................................................................................. 213 The analysis & processing phase ........................................................................................................ 228 Corporate information & data sharing phase ....................................................................................... 234 The presentation & publishing phase .................................................................................................. 240 The archive & reporting phase............................................................................................................. 243 Further reading for IT management?................................................................................................... 262
Chapter 3 – RESULTS: improving your capability ................................................................ 270
A glossary of your special words with dictionary files ......................................................................... 271 A convention poster in Microsoft Publisher ......................................................................................... 277 A Microsoft batch file for project management .................................................................................... 283 An HTML file to keep track of your projects ........................................................................................ 287 A quotation for work ............................................................................................................................. 295 A capital gains calculator ..................................................................................................................... 300 A comparison of vendor quotes ........................................................................................................... 305 A minimalist bibliography system ........................................................................................................ 308 A newsletter mailout............................................................................................................................. 311
Chapter 4 – DISCUSSION: integrating data ......................................................................... 315
A training or emergency plan ............................................................................................................... 317 A ‘Search Centre’ for web-based research ......................................................................................... 321 A catalogue of document files.............................................................................................................. 326 Time and expense account.................................................................................................................. 337
Geocomputing Management 5 An asset survey for your areas of interest ...........................................................................................346 An asset catalogue for the natural environment ..................................................................................351 A GIS for an investigation site ..............................................................................................................376 One-significant-figure company tracker ...............................................................................................380 Simple cash flow model with scenarios ...............................................................................................382 Transfer of a computer system ............................................................................................................386 Recovery from a computer failure ........................................................................................................430
Chapter 5 – CONCLUSION ................................................................................................... 460
Further research ...................................................................................................................................461 Future scripting or purchases...............................................................................................................466
Appendix – SCRIPTS ............................................................................................................ 468
poster.bat..............................................................................................................................................469 wom.bat ................................................................................................................................................473 styles.BAS ............................................................................................................................................479 projlib.xsl...............................................................................................................................................487
Appendix - GLOSSARY......................................................................................................... 489 Index ...................................................................................................................................... 515
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 6
Publication notes Grimoire of geological computing. Windows 10 edition. by Jacquier, G. L. (1962- ). Published and distributed by: Grant Jacquier PO Box 665, INDOOROOPILLY, QLD 4068 The bibliographic record in Thomson EndNote XML export format can be found at http://www.grantjacquier.info/grimoire.xml. Details of previous revisons are given in Table 1. This book is intended to be printed on recycled paper and bound in A5 format to sit conveniently beside the computer keyboard or kept in a pocket of a computer bag. Text, script extracts, programs, documents and any other associated material: © Grant Jacquier 2016; all rights reserved. All statements and analysis contained in this Grimoire are opinion only based on information from various sources which the author believes to be correct. The author accepts no responsibility for persons acting solely on this information for any purpose. All readers are advised to get independent advice tailored to their individual circumstances. Recommended retail price is AUD 10. Please pay this by either cheque made out to ‘Grant Jacquier’ and mailed to the above address, or give it to me in cash next time you see me at a Geological Society of Australia meeting.
Geocomputing Management 7 Table 1 revisions of the text and reading list MAJOR SUPPLIER (scope of purchasing information) revisions 1 LogiTech (South Australia) 1. c:\data\c_in_g\letters\cig9803.doc 2. c:\data\c_in_g\letters\c2000002.doc 3. c:\archive1\reports\unimelb\yr2000h2\j2000064.ppt 4. c:\data\c_in_g\letters\c2001004.doc 5. c:\archive1\reports\unimelb\yr2001q1\j2001079.ppt 6. c:\archive2\reports\unimelb\yr2002s1\j2002071.ppt 7. c:\archive2\reports\unimelb\yr2002s1\j2002079.ppt, j2002080.ppt 8. c:\data\c_in_g\letters\c2002013.doc 9. c:\data\c_in_g\letters\c2003001.doc 10. c:\data\c_in_g\letters\c2004001.doc Officeworks (Australia) 11. c:\DATA\C_IN_G\LETTERS\c2005001.doc 12. c:\DATA\C_IN_G\LETTERS\c2006014.doc 13. c:\DATA\C_IN_G\LETTERS\c2007001.doc 14. c:\DATA\C_IN_G\LETTERS\c2008002.doc 15. c:\DATA\C_IN_G\LETTERS\c2009005.doc 16. c:\DATA\C_IN_G\LETTERS\c2010005.doc 17. c:\DATA\C_IN_G\LETTERS\c2011001.doc 18. c:\DATA\C_IN_G\LETTERS\c2011014.docx 19. c:\DATA\C_IN_G\LETTERS\c2012002.docx JB Hi-Fi (Australia) 20. c:\DATA\C_IN_G\LETTERS\c2015003.docx NOTES 1 The revisons in the main part of the table are for the text and reading list. The revison of the bibliographic database is: i. c:\DATA\C_IN_G\LETTERS\c2001003.enl ii. c:\DATA\C_IN_G\LETTERS\c2005013.* iii. c:\DATA\C_IN_G\LETTERS\c2006036.* iv. c:\DATA\C_IN_G\LETTERS\c2008003.* and the revison of the glossary is: 1. c:\DATA\C_IN_G\KITBITS\glossary.20010430.enl 2. c:\data\c_in_g\letters\c2003002.rtf 3. c:\data\c_in_g\letters\c2003002.doc 4. c:\DATA\C_IN_G\KITBITS\glossary.20030905.enl 5. c:\data\c_in_g\letters\c2003004.doc 6. c:\data\c_in_g\letters\c2004002.rtf (sub-document for draft 11 to draft 19) 7. c:\DATA\C_IN_G\LETTERS\c2002001.enl 8. c:\DATA\C_IN_G\LETTERS\c2006020.* 9. c:\DATA\C_IN_G\LETTERS\c2008011.* 10. c:\DATA\C_IN_G\LETTERS\c2010008.* 11. c:\data\c_in_g\letters\c2012003.docx (sub-document for draft 19 onwards)
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 8
Preface Grimoire is a book of magical spells and this metaphor reminds me of how, when I first graduated, exploration and mine geologists suspiciously viewed the idea of using a computer in the field. I could use the term black-box, but I worked for Century Geophysical Australia running down-hole geophysics with the digital CompuLog system running in an air-conditioned dog box on the back of a Toyota DA115 20-tonne truck, and that box was cream with blue stripes. I had been convinced of the concept of “geological” by Mr David Stapledon, the head of school at the South Australian Institute of Technology where I had studied. He had worked on foundation and tunnel stability for major earthworks, such as the Snowy Mountains Scheme, and was then a member of the United Nations Commission on High Dams advising developing countries on irrigation schemes. His idea of “geological” was not “getting the names right on a box of dusty specimens in a museum”, but determining the “earth-logic”, as he called it, of the particular landscape where the construction was taking place, and then feeding back into the design, more realistic estimates of the physical properties involved. He impressed me because it was a philosophy which put science to the folk lore I had grown up with: bushcraft, boat-handling and watching the sea; every good bushman, seaman, prospector, miner, farmer and builder was a geologist, whether they knew it or not. In their time the logic demonstrated by these workers, was as magical to the uninitiated, as the entrance of the First Fleet into Port Jackson was to the Australian aborigine. Also at the Institute I had been given opportunity to use the mainframe computer and after years of suffering my manual calculation being spoiled by simple arithmetic errors, I was grateful for how you could easily repeat and adjust any
Geocomputing Management 9 calculation. The combined concept of “geological computing” crystallised for me after I reduced all the data from the Lochiel Trial Pit investigation, and demonstrated the simplest of dewatering models. I was then working for the Electricity Trust of South Australia, who had embarked on a million-dollar investigation, after initial measurements conducted by a consulting civil engineer had indicated that dewatering was highly complex. In comparing the data from the two studies, I found that the calibration errors and misplaced assumptions were the difference, and if the initial result had been carefully adjusted it would have removed the need for such an expensive follow-up experiment. Again more magic. So this particular grimoire is a collection of tables, diagrams and references to papers on all aspects of geological computing. It also contains glossary items that will be eventually transferred to the ‘Computers in Geology’ glossary. At each draft I have tried to add to the document and make it more applicable for special uses such as teaching, programming or system design; but at the same time use the separate parts to provide a comprehensive vision of geological computing. The next sections of this preface discuss how I have gone about this.
Who should read this grimoire? Geologists will always suffer not being at the same scale as their subject, and have always been chasing down tools to help them encompass the massiveness of the Earth. In earlier years geologists have enlisted the stratigraphic diagram, and geological maps then later there were globes for continental drift and aerial or space photography. Computers are just another way of reducing a model of the earth to about the size of a tabletop, so a handful of workers can share ideas and put forward theories based on the same data set. Apart from the general need for computing there are some special cases that this grimoire addresses and provide the themes for the exercises:
The exploration geologist, funded by seed capital, [or more modestly, a mortgage on the family home] who is preparing
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 10
an initial prospectus offering (IPO) before floating an exploration company on the stock exchange. Tongea expands on the flexibility available to a consultant working from an office at home and how it is an advantage to clients. Roachb asks that every geologist thinks about preparing local field guides for their local schools, to help improve delivery of earth science education. Allowing a geologist to publish a local geology field guide, without the full facilities of a geological survey, has only come about because of the rise of desktop publishing and mapping software for PC workstations.
The examples generally are for what I call ‘light’ computing systems. That is those systems, which are light in terms of weight, cheap and quick to build. Systems like these are required for geologists: needing a reasonably mobile field system, undertaking their PhD/honours project, working on seed capital before floating an exploration company, leading a local environment group, making a local field guide for schools, or running a one-person consultancy.
Other geological computing books This Grimoire is not going to be for everyone; it is subjective, and takes the perspective of an old-hand working alone. The shortage of skilled labour in the 21st century is encouraging more professionals to remain practicing. For example ‘Technology & more’ ran an article in 2008c on one of their clients, a surveyor Jeff Gwin in South Carolina, who with 23 years experience, and “lots of certifications in heavy construction inspection, materials testing” uses a robot theolodite to peg a four-lane highway, be on call for the construction company, and runs the whole thing out of a caravan parked next to the new pavement. However, if you prefer something more factbased you might try these:
Rob Tonge, How to become a successful consultant in your own field (Coolum Beach, 1991). Michael Roach, 'Australian earth science education and the GSA', The Australian Geologist no. 132 (2004), pp. 22-26. c 'Efficient by Choice', Technology & more no. 2008-1 (2008), p. 25. a b
Geocomputing Management 11
Nadar (1992)d for the computing perspective; Regan (1990)e is similar but for a commercial perspective; Willison (2009f) gives the teaching/communication theory; or Berkman (1989)g for field practices. Then there is Hillelh which I reviewed for The Australian Geologisti, and which I found to be a practical, mathematical approach to applied geology, though he does not provide any programming solutions, only the algorithms. Keith Johns (1974j) a former Chief Government Geologist has a short review on the role of a geological survey which gives the policy behind geological data collection and management practice. Follow that with Johnson (2012 k) for honing in on the data management perspective in an approach similar to John’s, an abstract of her thesis (Johnson 2011l). For the alternative of what can go wrong see Vandenberg (2012m) on the demise of the Geological Survey of Victoria.
But if you still want something subjective, there are alternatives to my industry focus. These approaches would better suit those scientists in academia or government:
In 2005, Graziella Caprarellin reviewed the work of Haneburgo which is based around the software Mathematica loaded with the CompGeosci.m library.
Jonah C. Nadar, 'Prentice Hall's illustrated dictionary of computing,' in Prentice Hall's illustrated dictionary of computing (Ealglewood Cliffs, New Jersey: Prentic Hall, Inc., 1992). e Michael Regan, 'Copyright,' in Australian Business Dictionary (Melbourne: Australian Business Library, 1990). d
f
John Willison (ed.), Handbook for research skill development and assessment in the curriculum (Adelaide, 2009). g David A Berkman, Field geologist's manual, vol. 9 (Parkville, Victoria, 1989). h Daniel Hillel, Introduction to environmental soil physics (Burlington, Massachusetts, 2004). i Grant L Jacquier, 'Introduction to Environmental Soil Physics by Daniel Hillel. The Elsevier Academic Press.', The Australian Geologist no. (2004). j R. K. Johns (ed.), History and Role of Government Surveys in Australia (Adelaide, 1976). k Vanessa E Johnson, 'The Role of Information Professionals in Geoscience Data Management: A Western Australian Perspective', LIBRES vol. 22, no. 2 (2012). l Vanessa E Johnson, 'The Role of Information Professionals in Geoscience Data Management: A Western Australian Perspective', Curtin University, 2011. m Fons Vandenberg, 'GSV in trouble', The Australian Geologist no. 161 (2012), pp. 7-8. n Graziella Caprarelli, 'Computational Geosciences with Mathematica', The Australian Geologist no. 137 (2005), p. 39. o William C Haneburg, Computational Geosciences with Mathematica (2004). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 12
In Dentith (2008)p the experience of the staff of the University of Western Australia is outlined, in how to put together a digital mapping programme for students, including hints on the camp, equipment, software and training. For the café latte drinkers doing their field work by mobile phone: Cockbain in 2011q reviewed the EarthObserver application for accessing the Marine Geoscience Data Systemr (GeoMapApp, Virtual Ocean) from Lament-Doherty Earth Observatory at Columbia University.
Script reference introduced in draft 14 In draft 14 of 2008, a script reference was set up where I copied a few of the more useful scripts into the appendix just for you to make the best use of as you could, and to help, there were suggestions in the exercises. Then in the ‘seven liberal arts and sciences’ edition, I altered the layout of the page for the section to landscape, so the lines of each of the scripts didn’t have to wrap around and the logic and comments were shown unaltered. I introduced the section because I was increasing the use of complex eXtensible Markup Languages (XML) documents to re-format raw data files into specific reports on the Computers in Geology webpages. It gives me the advantage of keeping a running list of search engine references and then uploading a new edition of the data file to the web-site, without having to re-edit that particular HTML page of the report. I can check and edit the data file in Thompson EndNote, a computer program for managing bibliographies, faster than I can keep a block of links and text in an HTML file. I have some theories on why this will work out better in the long term but it is not something that I would recommend generally, so I have left the explanation on my web sitel .
Mike Dentith, 'Introducing digital geological mapping into a 3rd-year field unit: experiences at the University of Western Australia', The Australian Geologist no. 149 (2008), p. 3. q Tony Cockbain, 'EarthObserver', The Australian Geologist no. 159 (2011), p. 41. p
r
The Marine Geoscience Data System (MGDS) includes web-sites: www.marine-geo.org, www.earthobserver.org, www.geomapapp.org, www.virtualocean.org
Geocomputing Management 13 There are very extensive comments in the scripts and for this you can blame a client Dr Rob Heath, who was repeatedly complained that the geoscience system documentation appeared as the first items in the Google search of the Santos intranet, rather than the exploration project summaries he preferred. If I had been more arrogant I would have blamed it on the IT department for the way they configured the search engine, but his words stung, and I subsumed the system documentation into the scripting, where they would be adjacent to actual logic for implementing these business rules. I realised there was a double benefit as I could do away with the repetition of the business codes into tables, and just refer directly to the logic in the script; and the logic extracts were more readable than my long-hand narrative. The readibility can be improved even further with a script browser, such as wom.bat, which I attached as Equation 100, for the “seven liberal arts & sciences” edition.
Exercises formalised into teaching units from draft 12 In draft 12 of 2006, the appendix of exercises was shifted to ‘Chapter 4 – METHODS: improving your capability’, with each example being more difficult than the last, it provides a syllabus for a series of computing practicals. This structure is primarily intended for teachers, but may also be of interest to the retired scientist getting to know their recently purchased system. In the ‘seven liberal arts & sciences’ edition the same principle was applied to the script appendix. The examples are still cross referenced in the main text to allow you to build up a system as you need it. The Ballarat map-sheet case study was dismembered from the early drafts of Chapter 4 and combined into the introductory chapters. This gives the opportunity just to show an example for a sub-section of the earth model/ore system combination where there isn’t a narrative. The original appendix of statistical distributions is now ‘Chapter 2 – METHOD: an ore system acts an earth model’, in the section ‘The loading data and verification phase’. This reflects that computing methods are essentially numeric and thought must be given to the expected outcome of any measurement. The previous two-part bibliography has been moved into ‘Chapter 5 – CONCLUSION’ into C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 14 the section ’Further Reading’. This now contains the references I would like to incorporate into the Grimoire at some stage, as well as those outstanding references which haven’t been moved to the footnotes (to work in with the check lists), plus what features I am watching in new versions of software.
Cross-references and Indexes I like indexes when I am in a panic and need an answer fast. In draft 9 the indexing of proper nouns was introduced and where this corresponded with a headword in the glossary, the page number given in the index was marked in bold. The indexed items correspond to firstly the narrative, and then the tables. Indexing is not consistent through out the examples but is concentrated where I have been reading to resolve a problem. The location of the index has been gradually moving to the back of the book. In draft 13 of 2007 the index was situated behind the glossary before the Appendix with the reference, but imptovements in Thomson EndNote and MS-Word allowed it to be placed as the very last section from draft 18 (Microsoft Office 2010 edition) onwards.
Examples This book uses Australian examples. This is because it is targeted to Australian geologists practising in the mining industry. However, this does not preclude use in an international context, quite the reverse in fact. A peculiar combination of custom, luck and economics makes Australia an ideal case study for geological computing. It was by luck that Australia was wholly settled by the British, which led to the first continent nation – Australia. Geologists with one language and without passports can examine the complete geological system from ocean crust to ocean crust. It was custom that decided that the mineral wealth should belong to the Crown and so all geological records are freely (or almost freely) available to the public and that that wealth should be untouched until the nineteenth century. The economic strength of the very active Australian mining industry means the Australian continent is well studied. With the Internet audience in mind, tables include northern hemisphere examples for comparison and regular professional use.
Geocomputing Management 15 For geologists getting their first computer I have included the specification I used to select my most current computer. In draft 11 the case study was rewritten from bullet-points into narrative. It is now supplemented by specific exercises within the discussion to help scientists and students build their own system as they are reading the notes. I have taken care to select software that is available for commercial use. For example, the Student & Home edition of Microsoft Office, and FamilySearch Personal Ancestral File, are very nice software, but the licensing is restricted to home or noncommercial use. Alternatively, if you pay more it is always tax deductible either as a cost of business or education. That said, I have shopped on a budget to maximise the money for the conventional research items like satellite imagery, field expenses and laboratory fees.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 16
Acknowledgement The following people were colleagues and participated in this book by their interaction in work that forced these concepts to be recognised. Business is a voluntary association and I thank these people for talking to me. Geoffrey ADAMS Triegue ALLEN Jim ALVEY ANAWATI Maria Wayne ASPINALL Steve AUFDERHEIDE Matthew BALL Richard BEARE Claire BEHAN Danielle BIEG Iain BISHOP Mark BISHOP Rowan BLAKE Jeremy BOLTON Keith BOYLE Belinda BRIDGMAN Mark BROWNE Robin BROWNE Mike BRUMBY Suryakant BULGAUDA Kingsley BURLINSON David CARVER Helen CHALLEN Nico CHART Adrian CORVINO Aaron CUMMINGS Jim DAY Lester DAVIES Michael DeBROUGHE Steve DeCAUX Patrick DesPLAND Wayne DEGANCE Neil DONNELLAN Matt DUBSKY Ian EDWARDS Graeme ERRINGTON-WOOD David EVANS Julian EVANOCHKO Mark EVERSON John FACCI Shane FARRELLY Bernie FARROW Mary-Ellen FEENEY-FERNANDEZ Max FRATER Tomas GANDUGLIA Darren GRAETZ Carmine GRASSO David GRYBOWSKI Chris HALL Lisa HALL Jo-Ann HART Rachel HARVEY Alasdair HAMILTON Nanthea HANNING Tanya HAYWARD Rob HEATH Lanair HEDGER-SMITH Martin HENDERSON Richard HILLIS Volker HIRSINGER Malcolm HORTON Sarah HOWIE Peter HOPGOOD Curtis HUMPHRIES David HUDSON Gareth HENDERSON Gary HUNTER Brendan ISBISTER Jim JAGO Lisa JEFFRIES Mark JOLLY Bob JOHNSON Chris KAY Irene KIVIOR Zbigniew KIVIOR Neil KOWALD Andrew KREMOR Rudhi KURNIADI Bob LAWRENCE Joseph LEACH Nick LEMON LOOI Siew Yuan Chris LUXTON Steve MACKIE Shaylene McCLURE Paul MACONOCHIE John McCORMACK Leigh MacPHERSON Andy MAGEE Robert MALCOLM Mandy MARLOW Greg MARCUS Dave MASTERS Angelos MAVROMATIDIS Ben MORETTI Dewi MORGAN Alistair MUIR Ed NEIL Dutch NEISWENDER Rob NORMAN Mick O’BRIAN Cliff OGILVY John PARKER Nick PAPNICOLAOU Malcolm PARK Joanna PEARSON Annette PETERS Carrina PHOENIX Andy PIETSCH Chris PORTER James PRICE Tim RADY David RAE Ilene REX Julie ROBERTS Steve ROBERTSON Brett ROGERS Daniel ROGERS Rod RYBURN Milena ROUSSEKOV Dave SALVIN Naz SAUNDERS David SAVAGE David SCHUBERT Rob SHAW Jeremy SIMPSON Jill SLATER Ric SMIT Cheryl SMITH Kerry SMITH Elaine SPENCE Ray SPICER Gavin SPRINGBETT Wence SULDA Darren STANTON David STAPLEDON Ed TADIAR Paul THEOLOGOU Lisa THOMAS Ann TOOMATH Melissa VALLEE Sam WALKER David WARNER Jasi WATSON Mark WEBER Bob WILTSHIRE Kerryn WINKLEY Kuniko YAMADA Zuraidah
Geocomputing Management 17
Contents Grimoire of Geological Computing ............................................................................................ 1
About the Grimoire of Geological Computing ..........................................................................................2 Coverage includes ........................................................................................................................2 About the author:...........................................................................................................................3 What the critics are saying: ...........................................................................................................3 Topics .......................................................................................................................................................4 Publication notes ......................................................................................................................................6
Preface ...................................................................................................................................... 8
Who should read this grimoire? ..........................................................................................................9 Other geological computing books ...................................................................................................10 Script reference introduced in draft 14 .............................................................................................12 Exercises formalised into teaching units from draft 12 ....................................................................13 Cross-references and Indexes .........................................................................................................14 Examples ..........................................................................................................................................14 Acknowledgement ............................................................................................................................16
Contents .................................................................................................................................. 17
Facts and checklists ...............................................................................................................................23 Examples and graphs.............................................................................................................................26 Commands and algorithms ....................................................................................................................27
Chapter 1 – INTRODUCTION ................................................................................................. 30
Why does the computing have to be geological? ..................................................................................31 A big bamboozle ...............................................................................................................................33 Surely it is just spatial information ....................................................................................................34 Variation of scale is common in geology ..........................................................................................37 Perhaps it is the uncertainty of it all..................................................................................................41 What are the key concepts?...................................................................................................................46 stratigraphy .......................................................................................................................................46 mathematical context ........................................................................................................................48 earth model .......................................................................................................................................53 natural history computing system .....................................................................................................55 ore system ........................................................................................................................................58 application of geological computing .................................................................................................59 Why not just buy the software? ..............................................................................................................64 How do I not waste my money? .............................................................................................................66 Understanding the strength in the American marketing style ..........................................................68
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 18 Understanding the strength in the Australian marketing style ......................................................... 70 Understanding the strength of the British marketing style ............................................................... 71 A little experience with the Nordic style of marketing ...................................................................... 74 When can I use a computer safely? ...................................................................................................... 76 Intellectual property hazards ............................................................................................................ 80 Marital hazards ................................................................................................................................. 83 Data theft .......................................................................................................................................... 84 Identity Crime.............................................................................................................................. 86 Legionellosis, temperature and humidity stress............................................................................... 91 Where can I get a computer? ................................................................................................................ 94 The “Toffee” computer system, 2016 to - ........................................................................................ 96 The “Belle” computer system, 2010 to 2015 .................................................................................... 98 The “Mitzi” system, used 2011 to 2016 ............................................................................................ 99 The “MrsPots” system, used 2005 to 2011 .................................................................................... 100 The “Luminiere” system, used 2000 to 2005 ................................................................................. 101 Desktop systems used 1992 to 1999 ............................................................................................. 103
Chapter 2 – METHOD: an ore system acts on an earth model............................................. 105
Choosing the equipment for a natural history computer system ......................................................... 106 Environment of use ........................................................................................................................ 108 Software modules .......................................................................................................................... 111 operating system software........................................................................................................ 113 Optional utility software ....................................................................................................... 114 Software for finding computer viruses ................................................................................ 116 software required to be supplied .............................................................................................. 119 System Hardware ........................................................................................................................... 121 The chip set for the computer ................................................................................................... 124 secondary storage .................................................................................................................... 126 data backup device ................................................................................................................... 127 CD-R for archives and backup ............................................................................................ 128 Read-Write archive disks .................................................................................................... 129 USB drives .......................................................................................................................... 129 Computer ports and a local-area-network (LAN) ..................................................................... 130 More than just ports ............................................................................................................ 132 Modem and wide-area-network (WAN) .................................................................................... 133 printer ........................................................................................................................................ 134 Hewlett Packard Deskjet 880C ........................................................................................... 136 Hewlett Packard Photosmart C2780 Multi-function printer................................................. 137 Cannon Bubblejet................................................................................................................ 138 Manuals, servicing and maintenance support ............................................................................... 139 Comparison and delivery ............................................................................................................... 141 Identifying the processes used in a computer system for natural history ........................................... 143 The logic processing sub-system................................................................................................... 144 using a parser for the logic ....................................................................................................... 144 special character codes ...................................................................................................... 146 object model herarchy .............................................................................................................. 148 non-metric spatial information .................................................................................................. 149 stratigraphic columns................................................................................................................ 150 geology block diagram.............................................................................................................. 151 the logic of the Ballarat earth model ......................................................................................... 152 The geometry processing sub-system ........................................................................................... 154 public mapping standards......................................................................................................... 159 recommended projections ........................................................................................................ 162 universal transverse Mercator............................................................................................. 168
Geocomputing Management 19 Albers Equal Area Conic .....................................................................................................172 VICMAP-TM (Transverse Mercator)....................................................................................172 VICMAP and VICGRID ........................................................................................................174 other projections in general use ................................................................................................175 Ballarat cartographic module ....................................................................................................176 The astronomy processing sub-system..........................................................................................176 Paper check list .........................................................................................................................178 Geological Survey Victoria VICMINE database........................................................................180 Spreadsheet schedule ..............................................................................................................180 Production history for the Ballarat earth model ........................................................................181 The arithmetic processing sub-system ...........................................................................................182 analytical module for the Ballarat earth model .........................................................................186 The grammar processing sub-system ............................................................................................187 office software ...........................................................................................................................189 bibliographic database ..............................................................................................................190 page format ...............................................................................................................................190 file format...................................................................................................................................191 The rhetoric processing sub-system ..............................................................................................192 Microsoft Outlook and Business Contact Manager ..................................................................193 Microsoft PowerPoint ................................................................................................................194 desktop publishing system ........................................................................................................195 The music processing sub-system .................................................................................................196 Using an ore system on an earth model ..............................................................................................199 The Ballarat sheet earth model ......................................................................................................205 The development phases of a Ballarat ore system ........................................................................205 The reference & indexing phase ..........................................................................................................206 Electronic reference and indexing ..................................................................................................209 Reference and indexing for a Ballarat ore system .........................................................................211 The loading data & verification phase ..................................................................................................213 Statistics for field data ....................................................................................................................215 Discrete distribution of variables ...............................................................................................215 Continuous distributions of variables ........................................................................................224 The analysis & processing phase ........................................................................................................228 Analysis & processing for a Ballarat ore system ............................................................................230 Geological model - facts ...........................................................................................................231 orogenic gold mineralisation ................................................................................................231 Geological model - fiction ..........................................................................................................232 Mathematical model ..................................................................................................................232 Select the input data .................................................................................................................232 Intersections of faults and host rock .........................................................................................233 Select fault intersections within hydrothermal influence ...........................................................233 Corporate information & data sharing phase .......................................................................................234 The Head Office syndrome.............................................................................................................235 Some theory of database design ....................................................................................................236 A good bet: the Extranet .................................................................................................................237 The Ballarat demonstration ............................................................................................................239 The presentation & publishing phase...................................................................................................240 Presentation & map for a Ballarat ore system................................................................................242 The archive & reporting phase .............................................................................................................243 Mapping the layout of your directories to projects..........................................................................249 Managing your archive and reporting system ................................................................................251 Policy for archive and reporting ................................................................................................252 Template for the archive and reporting .....................................................................................253 Hardware for the archive and reporting ....................................................................................254 The hardware considerations .........................................................................................................256 C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 20 Selection of a data exchange file format for archiving ................................................................... 259 Further reading for IT management?................................................................................................... 262 Further reading regarding Reference & indexing .......................................................................... 268 Further reading regarding analyses & processing ......................................................................... 268 The future for corporate information & data sharing ...................................................................... 268
Chapter 3 – RESULTS: improving your capability ................................................................ 270
A glossary of your special words with dictionary files ......................................................................... 271 Adding your custom dictionaries to Microsoft Office and Thompson EndNote ............................. 275 A convention poster in Microsoft Publisher ......................................................................................... 277 Adding extra figures to the poster .................................................................................................. 279 A Microsoft batch file for project management .................................................................................... 283 An HTML file to keep track of your projects ........................................................................................ 287 XML provides versatility in data handling ...................................................................................... 289 A quotation for work ............................................................................................................................. 295 Calculations for a campaign of field work ...................................................................................... 295 A capital gains calculator ..................................................................................................................... 300 A comparison of vendor quotes ........................................................................................................... 305 A minimalist bibliography system ........................................................................................................ 308 Make a concordance file for Microsoft Word. ................................................................................ 309 Make a glossary from the glossary database. ............................................................................... 309 Apply the concordance file to make index. .................................................................................... 309 Format the bibliographic references .............................................................................................. 310 Insert the glossary document into the report document ................................................................ 310 Update the report index.................................................................................................................. 310 A newsletter mailout............................................................................................................................. 311 Assumptions ................................................................................................................................... 311 Procedure ....................................................................................................................................... 312 Results............................................................................................................................................ 314 Conclusion...................................................................................................................................... 314
Chapter 4 – DISCUSSION: integrating data ......................................................................... 315
A training or emergency plan ............................................................................................................... 317 A ‘Search Centre’ for web-based research ......................................................................................... 321 A catalogue of document files.............................................................................................................. 326 Software and assumptions............................................................................................................. 327 The use of Thomson EndNote in preference to Microsoft Excel as a catch-all document database ........................................................................................................................................................ 329 Methods of making a catalogue file ............................................................................................... 333 Export an HTML catalogue direct from Thomson EndNote ..................................................... 335 Using Microsoft Excel for editing of the catalogue ................................................................... 336 The future: dedicated catalogue applications........................................................................... 336 Time and expense account.................................................................................................................. 337 Summarising your work for an accounting period ......................................................................... 338 Preparation of the Journal function in Microsoft Outlook ............................................................... 341 Configuring your Journal reporting spreadsheet ........................................................................... 342 Report the figures for an accounting period................................................................................... 344 An asset survey for your areas of interest ........................................................................................... 346 Why bother with an asset catalogue? ............................................................................................ 347 A single register in Microsoft Excel for small assets...................................................................... 348 An asset catalogue for the natural environment .................................................................................. 351 Interpreting a map from a geophysical image or photograph ........................................................ 352 Google Earth versus HTML links between plans........................................................................... 356 Make a location plan as the abstract ............................................................................................. 357
Geocomputing Management 21 Make a KML file for the introduction ...............................................................................................358 Use photographs as the background .............................................................................................361 Share the folders of your digital photographs on your intranet.................................................361 Showing thumbnails with Microsoft Internet Explorer ...............................................................363 Mount the photographs in Google Earth ...................................................................................366 Show your methods by local government area ..............................................................................367 Plot your results as thematic data ..................................................................................................369 Conclude with a map published to the intranet ..............................................................................370 A GIS for an investigation site ..............................................................................................................376 Manipulating Atlas boundary files ...................................................................................................378 One-significant-figure company tracker ...............................................................................................380 Simple cash flow model with scenarios ...............................................................................................382 Transfer of a computer system ............................................................................................................386 Documenting your computer ..........................................................................................................388 Before acceptance activity..............................................................................................................389 After acceptance testing .................................................................................................................393 Make your own Panic sticker ..........................................................................................................397 Installing Microsoft Office data .......................................................................................................398 Transferring Microsoft Outlook data ...............................................................................................401 business data ............................................................................................................................404 correspondence received..........................................................................................................405 Taking data from Business Contact Manager to Outlook contacts ..........................................406 Taking contacts from Microsoft Outlook into Business Contact Manager ................................407 Loading and configuring software ..................................................................................................408 Setting up an intranet .....................................................................................................................410 Installing the IIS service ............................................................................................................413 Mounting directories on the intranet .........................................................................................414 Mounting databases on the intranet .........................................................................................417 Early MS Access databases on the intranet .......................................................................420 Adjusting the data definition of the database ......................................................................421 Making a splash page ...............................................................................................................422 Cleaning out specific disk references .......................................................................................424 Preparing a computer for disposal .................................................................................................425 Removing Microsoft Office data ................................................................................................427 Recovery from a computer failure ........................................................................................................430 Glossary of panic ............................................................................................................................432 asset folder ................................................................................................................................432 diagnostics ................................................................................................................................432 display folder .............................................................................................................................433 DSL............................................................................................................................................433 OEM ..........................................................................................................................................433 recovery disk .............................................................................................................................433 universal serial bus (USB) ........................................................................................................434 Do this if you are panicking! ...........................................................................................................434 If you have panicked do this! ..........................................................................................................435 Return the computer to Internet use .........................................................................................437 Mobile phone network .........................................................................................................439 Return the computer to printing documents use .......................................................................441 Return the computer to editing documents use ........................................................................445 Return the computer to book-keeping use................................................................................449 Return the computer to communications use ...........................................................................451 Restart the science data processing .........................................................................................454
Chapter 5 – CONCLUSION ................................................................................................... 460 C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 22 Further research .................................................................................................................................. 461 Still more reading ........................................................................................................................... 462 More reviewing ............................................................................................................................... 464 Future scripting or purchases .............................................................................................................. 466 Generating a catalog file ................................................................................................................ 467 Converting image files to Grid files ................................................................................................ 467
Appendix – SCRIPTS ............................................................................................................ 468
poster.bat ............................................................................................................................................. 469 wom.bat................................................................................................................................................ 473 styles.BAS ............................................................................................................................................ 479 projlib.xsl .............................................................................................................................................. 487
Appendix - GLOSSARY ........................................................................................................ 489 Index ...................................................................................................................................... 515
Geocomputing Management 23
Facts and checklists Table 1 revisions of the text and reading list .................................................................................................7 Table 2 Geological cartoon by terrain class and use with type of development (after Berkman)...............40 Table 3 mapping database design steps to geological computing concepts ..............................................46 Table 4 stratigraphic systems ......................................................................................................................48 Table 5 relating three broad regimes of mathematics to geoscience application .......................................49 Table 6 geological modelling in a universal context ....................................................................................49 Table 7 geological modelling in a spatial context ........................................................................................51 Table 8 geological modelling in a spatial-historical context ........................................................................52 Table 9 components of a computer system used for natural history ..........................................................54 Table 10 a matrix of software for Computers in Geology before the introduction of Google Earth prior to 2005 ..................................................................................................................................................55 Table 11 natural history computing system for Computers in Geology circa 2010 ....................................57 Table 12 review of algorithm against geophysical measurement, processing and hardware ....................61 Table 13 marketing examples and commercial risk in geological computing .............................................69 Table 14 check list of system-design measures against hazard category..................................................79 Table 15 a comparison of risk reduction for data theft ................................................................................86 Table 16 risk matrix for identity theft............................................................................................................89 Table 17 consequences of identity crime ....................................................................................................89 Table 18 purchase types for previous systems of Computers in Geology..................................................95 Table 19 minimum specification for a new computer system ...................................................................107 Table 20 shopping lists for a geological computer system .......................................................................110 Table 21 software for the ‘Computers in Geology’ computing system ......................................................112 Table 22 major vendors and key to Table 21 ............................................................................................112 Table 23 drivers for additional devices ......................................................................................................114 Table 24 utility software against function ..................................................................................................115 Table 25 satisfaction matrix for virus-protection for a laptop ....................................................................119 Table 26 software to be supplied with the hardware .................................................................................120 Table 27 computer components (central processing unit) ........................................................................123 Table 28 current backup policy using a range of materials.......................................................................128 Table 29 weekly backup cycle for USB drives ..........................................................................................130 Table 30 ports for a hub, computer or printer ............................................................................................131 Table 31 check list for an observatory printer ...........................................................................................136 Table 32 resolution for the HP Photosmart printer ....................................................................................138 Table 33 packing lists for different activities ..............................................................................................140 Table 34 checklist for the premier quote and delivery...............................................................................142 Table 35 script editors for capturing logic..................................................................................................146 Table 36 pick list of parameters for making a GIS layer ...........................................................................156 Table 37 example plans by terrain class ...................................................................................................161 Table 38 general guide for use of map projections ...................................................................................163 Table 39 Lambert Conformal Conic projections ........................................................................................163 Table 40 geodetic monitoring networks after Featherstone 2....................................................................166 Table 41 central meridian2 for western hemisphere UTM zones1 .............................................................168 Table 42 central meridian2 for eastern hemisphere UTM zones1. ............................................................168 Table 43 estimates of offset from the MGA (Mapping Grid of Australia) coordinates for the old AMG (Australian Mapping Grid) and other datum ...................................................................................169 Table 44 official mapping grids used by Australian governments, sorted by projection used. .................170 Table 45 increasing precision of geodetic data .........................................................................................171 Table 46 geoid models ..............................................................................................................................172 Table 47 Albers Equal Area Conic projection for VICMAP .......................................................................172 Table 48 cartographic spheroids sorted by geometry. ..............................................................................175 Table 49 projections for government publications in Victoria....................................................................176 Table 50 uses for an astronomy processing sub-system ..........................................................................178 C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 24 Table 51 time axes versus action for spreadsheets ................................................................................. 181 Table 52 mathematics for geological problems after Berkman ................................................................ 182 Table 53 official height data. ..................................................................................................................... 183 Table 54 digital elevation models in order of sophistication. .................................................................... 184 Table 55 pick list of the analytical data themes for the Ballarat sheet earth model ................................. 186 Table 56 grammar and style rules versus report type .............................................................................. 189 Table 57 desktop-publishing software categories..................................................................................... 193 Table 58 audit of image post-processing software ................................................................................... 197 Table 59 possible Pangaea/Gondwana/Australia ore systems1 ............................................................... 200 Table 60 life cycles for exploration, research and communication versus computing focus.................... 203 Table 61 sample conversion of key words into project codes .................................................................. 209 Table 62 electronic file indexing schemes for geology ............................................................................. 211 Table 63 general notes to the discrete distribution functions ................................................................... 216 Table 64 remote sensing and geological computing stages..................................................................... 230 Table 65 check list for an ore system ....................................................................................................... 231 Table 66 Feldspar and quartz mineralogy of some igneous rocks ........................................................... 232 Table 67 list of the working e-mail folders................................................................................................. 235 Table 68 equivalent data structures. ......................................................................................................... 236 Table 69 the alignment of database design and presentation. ................................................................. 237 Table 70 browsing software for presenting data ....................................................................................... 241 Table 71 check list of archives against report stream............................................................................... 247 Table 72 allocating documents to research projects ................................................................................ 250 Table 73 nomogram for USB stick and DVD based archive/backup system with a fortnightly period ..... 251 Table 74 policy in terms of service levels for backup systems versus document management for archive systems .......................................................................................................................................... 253 Table 75 backup system versus archive system ...................................................................................... 254 Table 76 emergency recovery plan........................................................................................................... 256 Table 77 abbreviations and conversion of disk capacity .......................................................................... 256 Table 78 geological assessment of data-related philosophies ................................................................. 262 Table 79 a check list for a rational approach to geoscience data management ...................................... 265 Table 80 custom dictionary files for Computers in Geology, including buzzwords, and where you can find formal definitions ............................................................................................................................ 274 Table 81 check list to layout a poster in Microsft Publisher ...................................................................... 278 Table 82 check list for a document file...................................................................................................... 285 Table 83 sub-editing a document file ........................................................................................................ 289 Table 84 audit for the basic structure of any XML file............................................................................... 293 Table 85 basic financial facts .................................................................................................................... 295 Table 86 net income calculation................................................................................................................ 296 Table 87 Campaign costs ......................................................................................................................... 297 Table 88 Venture profit/loss analysis ........................................................................................................ 297 Table 89 integrating the venture costs into balance statement ................................................................ 298 Table 90 key cells for making a capital gains calculator........................................................................... 301 Table 91 computer proposals.................................................................................................................... 305 Table 92 file types used in Computers in Geology case studies .............................................................. 315 Table 93 check list for making a table map............................................................................................... 319 Table 94 named values for the insert in database.html ............................................................................ 322 Table 95 named formuale for composing engines.js ................................................................................ 323 Table 96 checks for making a 'search centre' ........................................................................................... 325 Table 97 other types of documents on a computer .................................................................................. 327 Table 98 alphabetical list of fields from EndNote with equivalent start tag from the EndNote proprietary XML ................................................................................................................................................ 330 Table 99 check list for making a catalogue of files ................................................................................... 334 Table 100 expenses incurred by geologists1 ............................................................................................ 337 Table 101 setting Microsoft Office for tracking project hours ................................................................... 338 Table 102 check list for annual tally of project hours ................................................................................ 340
Geocomputing Management 25 Table 103 project codes and conversion into expense type .....................................................................343 Table 104 summary table for work time allocation ....................................................................................344 Table 105 interpreting images for auditing buildings, dams, wells or other gross excavations ...............346 Table 106 formulae and headings for a MS Excel-based ‘built asset’ list.................................................349 Table 107 files and graphical components of an asset catalogue for the natural environment................351 Table 108 making a map from an interpretation .......................................................................................354 Table 109 making a diagram for an investigation .....................................................................................378 Table 110 the three main activities of moving to a new computing system ..............................................387 Table 111 facts for a new computer ..........................................................................................................389 Table 112 acceptance check list for a computer .......................................................................................392 Table 113 check list for cutting across to a computer system ..................................................................395 Table 114 the Computers in Geology recovery plan .................................................................................398 Table 115 check list for installing office software ......................................................................................400 Table 116 check list for adding e-mail accounts .......................................................................................403 Table 117 general check list for transferring software ..............................................................................409 Table 118 check list for setting up an intranet ...........................................................................................412 Table 119 disk folders mounted as web-sites on the intranet ...................................................................416 Table 120 database migration files............................................................................................................420 Table 121 data definition for various database formats ............................................................................422 Table 122 check list for Internet browser customisation ...........................................................................424 Table 123 check list for tidying up after a new computer ..........................................................................426 Table 124 cleaning out Microsoft Office before resale ..............................................................................428 Table 125 the disks for the recovery in the order of need .........................................................................431 Table 126 operating system activation details ..........................................................................................436 Table 127 network activation details ........................................................................................................439 Table 128 check list for configuring a mobile phone for data sharing .......................................................441 Table 129 peripherals and plotting software details ..................................................................................442 Table 130 office software installation details .............................................................................................444 Table 131 office software customised by account ....................................................................................446 Table 132 check list for finding data in the default folders ........................................................................448 Table 133 restoring your accounting system.............................................................................................451 Table 134 restoring your e-mail system ....................................................................................................453 Table 135 Thomson EndNote customisation ............................................................................................456 Table 136 Golden Software customisation................................................................................................458 Table 137 the impact of proposed development on the work flow ............................................................467
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 26
Examples and graphs Figure 1 the compliance pyramid ................................................................................................................ 53 Figure 2 count of software demonstrating the laws of geology .................................................................. 65 Figure 3 a geological computer system marked with the date when components were integrated ........... 67 Figure 4 an example of hyperbole from an American software developer ................................................. 68 Figure 5 plot of risks, for geological computing, by hazard and incident .................................................... 78 Figure 6 definition of Insider Trading from Ryan (1990) ............................................................................. 85 Figure 7 definition of "Confidential Information" from the ITCRA Code of Conduct, 2008 ......................... 85 Figure 8 identity crime definitions from the South Australia Police ............................................................ 87 Figure 9 occurrences of selected notifiable diseases from South Australia (after Buckett 2009, Communicable Disease Control Branch Report) ............................................................................. 91 Figure 10 temperature tolerances for selected computers plotted against critical temperatures for Legionellae bacteria ......................................................................................................................... 92 Figure 11 acceptable limits for humidity in computer operation and storage ............................................. 93 Figure 12 laptop computer air pressure tolerances .................................................................................. 109 Figure 13 the increasing speed of the micro-processor chip for geo-computing ..................................... 125 Figure 14 RAM capacity for geo-computing.............................................................................................. 126 Figure 15 previous disk capacity specifications ........................................................................................ 127 Figure 16 modem speeds for LAN: Ethernet, WiFi (or Bluetooth) ............................................................ 132 Figure 17 modem speeds for WAN connections: PSTN, 3G, ADSL2+ .................................................... 134 Figure 18 evolution of character coding from ASCII to UTF-8.................................................................. 147 Figure 19 checking MapInfo export files ................................................................................................... 153 Figure 20 some of the mapping files provided with Golden Surfer MapViewer ....................................... 154 Figure 21 hierarchy of public mapping projection standards .................................................................... 159 Figure 22 boundary displacement after reprojecting ................................................................................ 162 Figure 23 point displacement between AMG, WGS84 and MGA plots. ................................................... 170 Figure 24 comparison of spectral frequency and average equivalent distance of a pixel for several remote sensors ........................................................................................................................................... 185 Figure 25 the relative occurence of digital data types in the surveys of Johson ...................................... 207 Figure 26 the height of Mount Everest ...................................................................................................... 228 Figure 27 equivalent number of archive tapes.......................................................................................... 257 Figure 28 equivalent numbers of disks ..................................................................................................... 259 Figure 29 a print preview of a poster showing cut and pasting lines ........................................................ 281 Figure 30 essential elements for an HTML file ......................................................................................... 292 Figure 31 Scenario window ....................................................................................................................... 299 Figure 32 is the configuration for the Microsoft Outlook journal function ................................................. 342 Figure 33 the Field Settings window ......................................................................................................... 345 Figure 34 a list of shared photographs for a location................................................................................ 361 Figure 35 A photograph mounted and shown in Google Earth .............................................................. 363 Figure 36 the Photo Album folder template for Microsoft Explorer ........................................................... 366 Figure 37 map label for MapViewer .......................................................................................................... 372 Figure 38 add projection details in MapViewer ......................................................................................... 373 Figure 39 the settings for those little yellow pins on a research summary map ....................................... 374 Figure 40 MapViewer intranet publishing.................................................................................................. 375 Figure 41 cash-flow analyses plotted against risk-reward curve .............................................................. 385 Figure 42 panic sticker .............................................................................................................................. 397 Figure 43 the Find and Replace screen from Microsoft Wordpad ............................................................ 425
Geocomputing Management 27
Commands and algorithms Equation 1 resistance as a function of current and voltage, and the uncertainty for that value .................42 Equation 2 uncertainty function for geochemistry .......................................................................................43 Equation 3 an uncertainty function for a geological story of n facts............................................................44 Equation 4 use MS-DOS TYPE command to label text files as UTF-8 ....................................................148 Equation 5 printing out two pages of check lists .......................................................................................179 Equation 6 using VicMine data in Microsoft Excel ....................................................................................182 Equation 7 using VicMine data in Microsoft Excel ....................................................................................182 Equation 8 loading raster heights and Bougeur gravity in ArcView ..........................................................186 Equation 9 adding site measurements to the raster image in ArcInfo ......................................................187 Equation 10 specifying a flat plane ............................................................................................................187 Equation 11 using Microsoft Excel for a regional maths model ................................................................212 Equation 12 URL for code translation .......................................................................................................213 Equation 13 binomial distribution of a population ......................................................................................217 Equation 14 binomial distribution of samples by a Normal model ............................................................218 Equation 15 discrete geometric distribution ..............................................................................................219 Equation 16 uniform distribution ................................................................................................................220 Equation 17 Poisson distribution of elapsed time .....................................................................................221 Equation 18 Poisson distribution of counts per second ............................................................................222 Equation 19 Gaussian distribution .............................................................................................................223 Equation 20 uniform distribution of a continuous variable ........................................................................224 Equation 21 Poisson distribution of a continuous variable ........................................................................225 Equation 22 Standard Normal distribution of a continuous variable .........................................................226 Equation 23 Normal distribution of a continuous variable .........................................................................227 Equation 24 reference to the continuum of statistics ................................................................................228 Equation 25 iterations required for a Bayesian crawler.............................................................................229 Equation 26 iterations required for a Fuzzy Logic crawler ........................................................................230 Equation 27 - selecting input data in ESRI ArcView .................................................................................232 Equation 28 – Microsoft Excel formula to calculate the “check” field........................................................255 Equation 29 commands to make a dictionary from a Thomson EndNote database .................................272 Equation 30 converting an ANSI coded glossary.DIC file to the Unicode standard used with Microsoft Word 2010 ......................................................................................................................................273 Equation 31 modifying the dictionary in Microsoft Office 2010 .................................................................275 Equation 32 Adding your glossary to the custom dictionaries in Microsoft Word .....................................275 Equation 33 adding your glossary to the custom dictionaries in Thomson EndNote ................................276 Equation 34 making the poster background lighter ...................................................................................280 Equation 35 adding a snapshot to the poster ............................................................................................280 Equation 36 starting poster.bat from Microsoft Windows ..........................................................................283 Equation 37 statements used for project management in a batch file ......................................................283 Equation 38 XHTML extract showing a link to the project file poster.bat..................................................287 Equation 39 DTD (Document Type Definition) statements for various XML subsets ...............................290 Equation 40 XML Schema namespaces ...................................................................................................290 Equation 41 - making a new worksheet ....................................................................................................295 Equation 42 Creating named cells.............................................................................................................296 Equation 43 URL for a comparison spreadsheet ......................................................................................305 Equation 44 URL for an example computer specification .........................................................................306 Equation 45 conditional formatting for numeric cut-offs ............................................................................306 Equation 46 conditional formatting for ranked specifications ....................................................................307 Equation 47 identifying backward compatibility .........................................................................................307 Equation 48 EndNote bibliography template for a concordance file .........................................................308 Equation 49 MS Excel formula for an Index style concordance file ..........................................................309 Equation 50 Selecting addresses from Business Data Manager ..............................................................312 C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 28 Equation 51 Discriminating records by date ............................................................................................. 312 Equation 52 Discriminating contacts by category ..................................................................................... 313 Equation 53 mail merging in Microsoft Publisher...................................................................................... 313 Equation 54 mail merging in Microsoft Word ............................................................................................ 313 Equation 55 Multiple copies in Microsoft publisher ................................................................................... 314 Equation 56 a business note for several contacts .................................................................................... 314 Equation 57 commands for making a search centre ................................................................................ 323 Equation 58 structure of the EndNote proprietary XML format................................................................. 330 Equation 59 making an HTML catalogue file ............................................................................................ 335 Equation 60 Microsoft Excel macros for the sheet tally used to convert the Journal entries ................... 343 Equation 61 making a location plan in MapViewer ................................................................................... 357 Equation 62 the initial lines of world.kml showing the table of contents given in the
… element........................... 358 Equation 63 extract of world.kml showing the first
immediately below the definitions............................................................................................................. 359 Equation 64 KML entry using the geographic coordinates for Lyon ......................................................... 360 Equation 65 sharing the folder om2008 in Windows XP as http://localhost/om2008 ............................... 362 Equation 66 commands to run Microsoft Explorer in a MS-DOS bat file.................................................. 364 Equation 67 changing the folder om2008/Jacquie008325 to be viewed as thumbnails in Microsoft Explorer (Windows XP edition) ...................................................................................................... 364 Equation 68 the
with a reference to oman2008.bat .................................... 365 Equation 69 making a context plan in MapViewer .................................................................................... 368 Equation 70 URL for Department of Primary Industries, Victoria ............................................................. 368 Equation 71 adding Hobart to the cities database .................................................................................... 370 Equation 72 selecting Australian cities ..................................................................................................... 370 Equation 73 setting capital city pins .......................................................................................................... 370 Equation 74 MapViewer commands to scale an A6 location plan into a A4 full-screen summary for your Intranet ........................................................................................................................................... 371 Equation 75 MapViewer commands to put little yellow pin icons on your areas of research map .......... 374 Equation 76 coordinates for suprm01.bna ................................................................................................ 379 Equation 77 Loading an Atlas boundary file ............................................................................................. 379 Equation 78 producing a company rankings report .................................................................................. 380 Equation 79 Student exercises in Microsoft Excel .................................................................................... 383 Equation 80 Formulae for a simple cash flow model ................................................................................ 384 Equation 81 aborting the installation procedure for Norton Internet Security to prevent nuisance e-mails ........................................................................................................................................................ 391 Equation 82 Making Libraries to speed up searches for documents in MS Windows 7 .......................... 394 Equation 83 configuring Microsoft Outlook ............................................................................................... 401 Equation 84 importing a personal mail folder and then renaming it ......................................................... 405 Equation 85 mounting an archive folder in MS Outlook ........................................................................... 406 Equation 86 restoring your Personal Folder into MS Outlook .................................................................. 406 Equation 87 URL for the apology for leaving Business Contact Manager out of Microsoft Office Professional 2010, and the download instructions ........................................................................ 407 Equation 88 – Setting up the Business Contacts Manager and removing the supplied business database ........................................................................................................................................................ 408 Equation 89 initiating Microsoft IIS (Internet Information Service) in Windows XP .................................. 413 Equation 90 initiating Microsoft IIS in Windows 7 ..................................................................................... 413 Equation 91 specifying the base directory for Microsoft IIS in Windows 7 ............................................... 413 Equation 92 mounting a directory on the Intranet in Windows XP ........................................................... 414 Equation 93 mounting a directory on the Intranet in Windows 7 .............................................................. 414 Equation 94 creating a MIME type for bat in Windows 7 .......................................................................... 415 Equation 95 converting geotimes4.mdb database (Access 2000 format) to a geotimes5.accdb (Access 2010 format) ................................................................................................................................... 421 Equation 96 creating a splash page for the Intranet ................................................................................. 423 Equation 97 MS-DOS batch file for project management......................................................................... 469
Geocomputing Management 29 Equation 98 an MS-DOS batch file to browse other scripts ......................................................................473 Equation 99 a VBA compliant script for formatting shapes in a plan ........................................................479 Equation 100 an XSL script to compile a table of references hyperlinked to digital files .........................487
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 30
Chapter 1 – INTRODUCTION This chapter deals with those broad questions that I get asked at drinks before the meeting of the Geological Society of Australia and always make a hash of answering in twenty-five words or less:
Why does the computing have to be geological? Why not just buy the software? What are the key concepts? Where can I get a computer? When can I use a computer safely? How do I not waste my money?
Geocomputing Management 31
Why does the computing have to be geological? In commerce mistakes are paid for. In practice in the physical world mistakes lead to more severe consequences. Information about the physical world needs to be good as or better than that in the financial realm. I have various coroners’ reports in mind but in explaining the crash of the Air New Zealand DC-10 into Mount Erebus in 1979, Stewart wrote in 2009s:
‘Fourteen months earlier, a staff member in Air New Zealand’s navigation department had made a typing error when inputting navigation co-ordinates for Antarctic flights into the airline’s new computerised system’ This tourist flight was exploiting the geology for commercial gain, and while this use is not as dusty as most, I think it does introduce that management of computing for geology is different and is not well done by the average clerk who runs the IT department. In a way that is similar to the difference between classical statistics and geo-statistics: the problems stem from not being able to get around the subject in the same way you can a human body. Mackie t also adds that even in the seemingly arms-length case of drilling for oil, you cannot afford to fail because the consequences are so expensive. Mackie’s example is a level down from the Air New Zealand example, but there are other geological situations such as building high dams and footings for nuclear power plants, where the cost of failure is greater again. Jahshan (2009 u), just looking at the mapping side alone, enunciated my fears with:
‘It would seem that custodians of spatial data and practictioners of spatial technology inhabit a different world from the managers of enterprise data… most organisations do not see spatial applications as mission-critical… they are considered to be fourth or fifth in line after core business systems, email, asset management and document Cameron Stewart, 'Sightseers doomed before take-off,' in The Weekend Australian (Adelaide: News Corporation, 2009). t S I Mackie et al., 'Real-world decision making in the upstream oil and gas industry—prescriptions for improvement', APPEA Journal vol. 48 (2008). u Anthony Jahshan, 'Changing corporate philosophy', Position Magazine no. 42 (2009), pp. 72-73. s
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 32
management…Why do organisations wait until they are experiencing a crisis before they turn to spatial applications for the answer… all we can do is pray for change.’ However, geological computing may not be a valid concept and so to examine it further I have found four themes from the literature which I continue in the sub-sections below. This book really isn’t about philosophy [well not the un-natural kind]. It is about building a computer system for yourself [that works] but I included these sections to help you justify any proposals for stand-alone systems:
“It is all big bamboozle and I should just get on with it” “It really is surveying information and not a big deal, it has all been done before” “Yes you can never be certain about what you measure in the field, so why bother”. “The birds and the dinosaurs; variation of scale is common in geology”
There is one thing that is definitely the same with other computing systems. Computing has become laden with ridiculous jargon and geological computing is no different. I am not being ironic, having before writing this spent three paragraphs on statistical formula (actually Equation 2 and Equation 3), as there is a difference between the confabulated verbage of the computer salesman and the universal language of mathematics. In this grimoire the jargon has been kept to a minimum but some terms should be defined and will assist the reader with further research and these can be found in the ‘Glossary of Geocomputing’ in the Appendix. But one more quote from Williamson: “Spatial data is a special type of data … it requires a dedicated commitment and strategy to capitalize upon its advantages”.
Geocomputing Management 33 If you are still not convinced you may like to read Bettenay v, or Case et. al.w, or for scientific analysis of geological decision-making try Mackiet.
A big bamboozle So, some of the things, which I think scare or bamboozle the clerk working for the first time in the agricultural, mining or construction industries:
the massive size of the data sets (Yacopetti and Mundellx quote doubling in size every 12 to 18 months), the great inter-dependence of the measurements the great uncertainty of any analysis the subsequent cost of an error in processing (perhaps deaths) the requirement for continually having to improve the methods of discovery, and subsequent purchases of new software the role of the Crown, that is the community, in retaining the data (the ‘statutory reasons’ of Abercrombie 1989y) the very high cost of acquisition of data the inter-disciplinary need for the data the long currency or shelf life of the data the high latency in our data sets general misunderstanding of the earth the small differences between a valid and an invalid data set
Yacopetti and Mundell are more prosaic, making a simile of geological information with a living organism that grows, replicates v
Leigh F. Bettenay, 'An overview of the use of computers in exploration in Western Australia. ,' in Computers in Exploration, Australian Institute of Geoscientists Bulletin No 9 (Australian Institute of Geoscientists, 1989). w M. P. Case et al., 'Decision support capabilities for future technology requirements,' ed. Corps of Engineers U.S. Army Technical Report ERDC (CERL, Champaign, Illinois, 2001). x Matt Yacopetti and Stephen Mundell, 'Improving the quality of geoscientific information,' in Bowen Basin Symposium 2010 (2010). y
Christine M. Abercrombie, 'Text retreival for mineral exploration companies or find what you file,' in Computers in Exploration, A.I.G Bulletin (Sydney: Australian Institute of Geoscientists, 1989). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 34 and mutates with time; as compared to the “static information” of conventional IT. That is why I needed this book, to write down all the little tips I have picked up from the other geologists listed in the Acknowledgement, and which the information technology texts don’t cover. However, I am also careful to return quickly to regular practice where I can. I take care to do this because if too ‘bamboozled’ the clerk managing the organisation’s computing will begin to believe that geology is a rogue and random science, and refuse to accept any kind of earth logic, just like a drilling contractor who subscribes to pattern drilling after spending too much time around second-rate field geologists.
Surely it is just spatial information Geological computing also has a spatial, geographical or land surveying component and Williamsonz points that this introduces further peculiarities which he lists as:
spatial data is scale-dependent spatial queries are inherently complex all spatial data is dependent on data models, which have many and varied dimensions integrating spatial data with other data other data types is particularly difficult, due to different data structures
Williamson also stresses the importance of the data because humans think spatially and he sees an 8400-year development, with images overcoming language difficulties: i.
ii. iii. iv.
primitive hunter gatherer societies using topologically-correct mappings, to convey critical spatial-dependent issues of survival, just as with Aboriginal cave paintings property ownership infrastructure development trade and defence
I disagree with him, I think the critical issue to the cave paintings and early maps is not that it has spatial information or are language z
Ian Williamson, 'Is spatial special', Position no. 21 (2006), p. 17.
Geocomputing Management 35 independent but rather they act as prototypes to allow people to practice hunting or keep taboos or test a group endeavour before actually putting the community or any resources at risk. Jahshan (2009aa) stresses the need for something that is ‘spatial +’ for the modern corporate world with:
‘Spatial applications lack the intimate integration with mission critical systems …would a paradigm shift in thinking and planning. … the heart of any accounting system is the general ledger… the single most missioncritical application for any organisation’ Support for my view has come from Mackie t who found empirically that the modelling activity dominates the oil/gas sector decision process, and perhaps this is a modern reflection of that primal instinct. Also Spencer in 2011bb stresses that the introduction of web technologies has side-lined the bland application of geographical information systems and the specialist now needs to provide “geographic projections, generalisation, symbolisation and heavy spatial analysis” which curiously for me could be called “setting, methods, results and discussion” the work of any earth scientist. However, Williamson hasn’t overlooked this concept totally, he also has found problems with the implementation of technology by bureaucrats where there hasn’t been due consideration to what we know of the logic of nature as in his quote:
“All too often, governments have responded to this complexity by creating massive, replicated databases, largely ignoring the capacity of spatial information to establish relationships between datasets.” Wintercc dissects spatial information again in 2008, this time specifically mentioning “field phenomena” of “elevation, soil, temperature, wind or humidity.” In that article he examines the definitions from different surveying groups (the definitions are given in Table 80 for custom dictionary files). Of the three definitions there he claims that the government study definition is the least useful aa
Jahshan, 'Changing corporate philosophy', no.
bb
Brad Spencer, 'Spatial is not so special', Position no. 48 (2011), pp. 54-55. Stephan Winter, 'What is the Value of Spatial Information?', Position Magazine no. 35 (2008), pp. 5455. cc
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 36 [from a business sense] and makes these points about what are missing from that definition: 1. It neglects “field phenomena” of “elevation, soil, temperature, wind or humidity.” 2. it neglects all non-metric spatial information (Winter asks you to think of the London Underground Transport map) pointing out that “place descriptions are hierarchic and purely topological which makes them effective in communication” 3. time is missing 4. scale is neglected Winter resonanates with the kind of problems overlooked by clerkdesigned systems he feels that indications of connectedness, nearness, size and tardiness may even be more important than the measured distance, especially when you are catching a bus. It is a bit hard to argue against that: as who takes shortcuts to the bus stop when they know the next bus will have no spare seats. He does seem to address our problems but immediately throws in the disclaimer “microbiological or astronomical problems are often very spatial, but outside our [surveyors] realm”. He then goes on to puts some computer aided design (CAD) outside of the realm as well. Conversely, in the same magazine in 2009 Kinne dd argues that bringing CAD and GIS data together, as pioneered by architects for the using shade effects in the design of air conditioning, is a requirement of planning for development, citing for that situation that:
dd
it provides an alternative decision path to making conservative decisions where understanding is incomplete it reduces conflict where developments are of a large value it handles the increased complexity of compliance requirements for large developments it provides realism for decision-making by a general population
Peter Kinne, 'The Digital World', Position Magazine no. 38 (2009), pp. 65-66.
Geocomputing Management 37 Again we have echoes of the principles of loss of opportunity [missing the gold strike], the problem is too massive, the problem is too complex, the problem is too arcane and yet the development has a high impact on the people involved. For me that demonstrates it depends on the individual surveyor whether they will take on, or leave your particular scientific computing requirements.
Variation of scale is common in geology Often the first introduction a person has to geology is primary school classes on dinosaurs. Dinosaurs are to geology, what Vikings are to history, a guaranteed crowd pleaser. After terrifying children for ten minutes, you can put them to sleep by the pleasant notion that these ferocious ground tremblers evolved into the peaceful and delicate honey-eaters (the Australian equivalent of humming birds). So how does this relate to measurement, a recent article by Smith gives the example of Egyptologists, who as practising a sub-branch of archaeology are required to think geologically [remember that the first classical geologists were Anglican ministers speculating on Noah’s flood]. Smithee points out that
“Archaeologists are the most meticulous and versatile of explorers. They may cover vast distances in a few days or mere inches in a month. Their discoveries can range from massive temples or burial sites to tiny shards of pottery scattered across an endless desert plain” Surveyors are very uncomfortable with variance of scale, both Williamsonz and Wintercc mention the recognition of scale as critical in the distinction of spatial information systems for other computing systems. How do surveyors cope? Well they don’t, they make do. Their methods developed from well-populated and flat England, require the selection of evenly spaced points to mark up the geography. These points must be spread into a network of regularly sized cells, which are then used to distribute an error in measurement around the boundaries of each cell. The size of the cell decides the relative accuracy of the points taken in that area, the largest cell in the network decides the absolute accuracy of all the measurements taken.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 38 I can now recall many times when working on the pod-like basins of the Leigh Creek Coalfield, that surveyors would put a temporary benchmark, take sights on my instruments and then bring that mark in later after I had packed up. What they did was then make up a series of temporary marks to close on that bench mark and extend the mine grid. I can think of three exercises where I didn’t pay enough attention to keeping the cells of the surveying network similar and then puzzling over why I couldn’t close the grid to the satisfaction of my supervisors. One was at South Australian Institute of Technology when we surveyed an urban park and one of the marks was at the irregular narrow end of the park, which caused an elongated cell in the network. It was a lack of understanding, which I never picked up on even though I can also remember being told to make those cells regular by my surveying lecturer, Mr Tan, we should have slipped into the work some temporary marks. The other example was when I was working for Ken Bampton at the Mutooroo solution copper mine, then leased to Adelaide Wallaroo Fertilisers., It is located near the state border the states of South Australia and New South Wales. The Muteroo deposit is associated with the passage of copper rich fluids along a sheared zone, linear in extent, so the mine workings are not placed together but strung out. Well I just shot from corner of building to corner of building, not bothering to make nice cells and all these years I have wondered how I could have made so many errors of transcription that the resulting drawing in the Adelaide office was so obviously wrong. The third example was picking up drill holes with compass and pacing along the road and fire break outside of the mine fence at the Nabarlek uranium mine in Arnhem Land in the Northern Territory. I can even remember the surveyors later taking the trouble to work inside the fence to make more regular cells. I have heard this anisotropy in distribution of measurements, called sampling bias, but that is from the view of the technology provider, and not the scientist doing the work, and funding the budget. The unsuitability of conventional surveying has even resulted in the totally alternative methods such as those for archaeology described in Smithee, resulting in tedious narratives of where finds were made along roads and in the passing to the major archaeological site, which may take years to reconstruct into a useable map. Often the site would be surveyed during excavation but its absolute position ee
Jason Smith, 'Mapping Ancient Sites', Position Magazine no. 39 (2009), pp. 53-55.
Geocomputing Management 39 would not be known well and Smith gives examples of where complete digs have been lost and could not be relocated for follow up work. The good news as Smith emphasises is that GPS (Global Positioning System) has been very popular with natural historians of all types because it does in practice allow for variations in scale. Widely spaced points along a traverse can be surveyed quickly and their accuracy is not the best but it is effective in that context. When you do get to a site of significance which requires close measurement and intensive activity, you just leave the GPS turned on for longer to use additional transits of satellites and the accuracy improves, also effective as the archaeologist are flat out digging anyhow and won’t be moving for a while. And there is even more hope for the future, because when data is transformed from the geographical domain to the space-time continuum (introduced in the next section), the variations of scale are reduced, there is no anisotropy in the distribution of measurements, and the conventional surveying techniques become accurate without adaption. This is what is done graphically in a geological block diagram; some of the best I have seen are in Table 2. Taken to the theoretical extent there is the oddity of the Tetrahedral Hypothesis resurrected recently in ‘The Australian Geologist’ff where, before the general acceptance of continental drift theory, a gentleman, Lothian Green, was reported to argue that the distribution of the continents on the earth could be explained by considering the oceans as a series of facets with the continents occupying the intersections of planes. This hypothesis is the basis of the block modelling in ‘The logic processing sub-system’, where the facets are the surfaces of the block diagrams produced out of Golden Software’s Surfer. In more grounded sense, the world’s most used mining software Datamine has the Folded Geostatistics option in the Studio 3 softwaregg which demonstrates this principle.
Tor Mentor, 'A few more teasers to exercise the brain in 2009', The Australian Geologist no. 151 (2009), pp. 34, 44. gg 'Studio 3 and Folded Orebody Data ', 2009 (Datamine LLC, 2009). ff
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 40 Table 2 Geological cartoon by terrain class and use with type of development (after Berkman) Terrain class (and when it is relevant to development) 1 Province (mineral exploration, deep underground work, first estimates of rock properties) Terrain pattern (transport specification, topographic survey for hydropower dams) Terrain unit (location of transport, buildings, open cut mines and major dams) Terrain component (flooding, trafficability, pavements, foundations, portals and farm dams) geological cartoon your situation: Rift Basins – part 1 and 2 by Kirk 2011hh,ii Origins series of the Weekend Australianjj ‘Basin Floor Fans – part 1 to 4’ by Kirk 2010kk,ll,mm and 2011nn ‘Source Rocks – Part 1 to 2’ by Kirk 2011oo,pp ‘Slopes’ Part 1 to 2 by Kirk 2010qq,rr ‘DHI Seismic facies’ by Kirk 2009ss Cryogenian Reef Complexes by Wallace et.al.tt ‘Sesimic Facies Mapping’ Part 1 to 2 of Kirk 2011uu and 2012vv 7.4.2 ‘Classification of Landslides’ in Berkman 1989g LEGEND hh
X X X X X X X X X X
X X X X X
Rob Kirk, 'Rift Basins - Part 1', PESA News Resources no. 110 (2011), pp. 52-54.
ii
Rob Kirk, 'Rift Basins - Part 2', PESA News Resources no. 111 (2011), pp. 60-62. jj Leigh Dayton, 'The red heart,' in The Weekend Australian (Sydney: 2005)Leigh Dayton, 'From black rocks to red gums,' in The Weekend Australian (Sydney: 2005)Leigh Dayton, 'Before the dreamtime,' in The Weekend Australian (Sydney: 2005). kk Rob Kirk, 'Basin Floor Fans - Part 1 of 4', PESA News no. (2010), pp. 76,78 & 80. ll Rob Kirk, 'Basin Floor Fans - Part 3 of 4', PESA News no. (2010), pp. 68-71. mm
Rob Kirk, 'Basin Floor Fans - Part 2 of 4', PESA News no. 107 (2010), pp. 64-66. Rob Kirk, 'Basin Floor Fans - Part 4 of 4', PESA News Resources no. 109 (2011), pp. 62,63,64,65. oo Rob Kirk, 'Source Rocks - Part 2', PESA News Resources no. 113 (2011), pp. 60-62. nn
pp
Rob Kirk, 'Source Rocks - Part 1', PESA News Resources no. 112 (2011), pp. 45-46. qq Rob Kirk, 'Slopes - Part 1 of 2', PESA News no. 104 (2010), pp. 61-63. rr
Rob Kirk, 'Slopes - Part 2 of 2', PESA News no. 105 (2010), pp. 24-30. ss Rob Kirk, 'DHI seismic facies', PESA News no. 100 (2009), pp. 57-61. tt
Malcolm Wallace et al., 'Cryogenian Reef Complexes of the northern Flinders Ranges,' in 6th Sprigg Symposium: Unravelling the northern Flinders and beyond, ed. Caroline J. Forbes, Abstracts 100 (Adelaide: Geological Society of Australia, 2011). uu Rob Kirk, 'Seismic Facies mapping: Part 1', PESA News Resources no. 114 (2011), pp. 69-71. vv
Rob Kirk, 'Seismic Facies mapping: Part 2', PESA News Resources no. 115 (2012), pp. 46-49.
Geocomputing Management 41 X : this cartoon is confined to the context of this terrain class. NOTES 1 7.9 Stages of engineering construction in relation to the terrain classes, page 291 of Berkman 1989 g
Perhaps it is the uncertainty of it all Jon Fairall was the editor of the GIS User, which became Position Magazine, for 20 years. In his interview reported there in 2010 ww he spoke how the enduring issue was the quality of the data. He next mentions how this develops into a “fixation with database integrity” and custodians controlling and owning data, without allowing access by others. People are constantly worrying about the quality of their data for the purposes that other people want to use it for. His advice is that timeliness is essential, allowing end-users opportunity to adjust that data, to speed the process. So thirdly, with some data in time as the only practical outcome, expressed as a mathematical basis, there is an emphasis on uncertainty of the data, even to the extent that the uncertainty is more important than the value. Though, the uncertainty should also be a value as Griffiths (2011 xx) finds that the debate about man-induced climate change to be ‘armwaving’ instead of the ‘quantitative contribution to forecasting’ required for the International Panel on Climate Change. When I first started consulting, colleagues would tease me with the words “All I need is a program which will tell me where to drill”. Similar to the concerns of Griffiths, I am not sure that meets the policy from departments of mines, nor the JORC code for the ASX stock exchange. Those parties would prefer some knowledge of the health and safety aspects at least, but I did recently realise what an algorithm for that would look like. Mathematically it would give ‘the uncertainty that the cut-off for commercial grade of ore was below at mineable depth’, and so the nearer to zero, the more likely is you should drill, you don’t need anything else to be plotted. Does this have a real impact? Lamontyy, in paper on geophysical modelling for oil drilling concedes that it does.
ww
Paul Kelly, 'The final view', Position Magazine no. 46 (2010), p. 10. xx Cedric Griffiths, 'Geological community arm-waving on Climate Change', PESA News Resources no. (2011), p. 17. yy Matthew Lamont, 'A discussion of seismic amplitude analysis in the new millenium', PESA News no. 100 (2009), pp. 52-55. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 42
“Different information has value on its own, but independent information adds non-linearly. That is if two bits of independent information say the same thing, then the whole is more valuable than the sum of its parts, one plus one can equal four and vice versa. Therefore it is very important to analyze prospects from every meaningful way possible.” How this works, is that geology is really about telling a story linking facts together with one or more of the twenty laws found in the Dictionary of Geological Termszz. In contrast geophysicists will exploit one equation such as determining the resistance of the rock mass in (a) of Equation 1. The uncertainty involves the product of the probabilities of true readings of the current and the voltage, no mean feat if you have thick, conducting soils like we do in Australia. Equation 1 resistance as a function of current and voltage, and the uncertainty for that value
I (a) V U ( 1-p(I).p(R) ) U ( 1-p(I.R)) (b) R
n
U 1- p(i) i 1
Conversely, for a geochemical system the reactions are related to proximity and the work in the 1930s on gold sampling by Krig has given his name to the uncertainty principles, very roughly paraphrased from Knudsen 1987aaa in Equation 2.
William H Matthews, III and Robert E. Boyer (eds.), Dictionary of geological terms (Garden City, New York, 1976). aaa H. Peter Knudsen, 'A capsule view of Geostatistics', in Ernest Y. Baafi (ed.), Geostatisitics - theory and practice. A 4 day short course July 7,8,9,10, 1987 (Wollongong, New South Wales, 1987). zz
Geocomputing Management 43 Equation 2 uncertainty function for geochemistry
n 2 2 U f c z i . x1 x0 y1 y 0 i 1 Alternatively, in a geological story of diverse, numerous facts, the probabilities of the different observations are additive as per the generalised case of Equation 3. Though this does assume that there will be a large number of cases or sites, and the occurrence of the event will be unlikely, and roughly the same uncertainty for each observation. This may seem a particularly onerous set of circumstances, but this is very typical of fossicking, exploration drilling or designs for extreme weather.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 44 Equation 3 an uncertainty function for a geological story of n facts
U ( 1 p(z 1 )) (1 p(z 2 )) (1 p(z 3 )) U (1 ( p(z 1 ) p(z 2 )) p(z 2 ) p(z 1 )) (1 p(z 3 )) U 1 ( p(z 1 ) p(z 2 )) p(z 2 ) p(z 1 ) p(z 3 ) p(z 3 ) ( p(z 1 ) p(z 2 )) p(z 3 ) p(z 2 ) p(z 1 ) U 1 ( p(z 1 ) p(z 2 ) p(z 3 )) p(z 2 ) p(z 1 ) p(z 3 ) p(z 1 ) p(z 3 ) p(z 2 ) p(z 3 ) p(z 2 ) p(z 1 ) n
U 1 p( z i ) i 1
p(z 2 ) p(z 1 ) p(z 3 ) p(z 1 ) p(z 3 ) p(z 2 ) n
p( z i ) i
n
0 p( z i ) i
p(z 2 ) p(z 1 ) p(z 3 ) p(z 1 ) p(z 3 ) p(z 2 ) p(z 3 ) p(z 2 ) n
U 1 p( z i ) i 1
p(z n ) ( p(z n 1 ) p(z n 2 ) p(z n 1 ) p(z n 3 ) p(z n 2 ) p(z n 1 )) 0 n
U 1 p ( z i ) p(z n ) 0 0 i 1 n
U 1 p( z i ) i 1
All these uncertainty functions are mathematically equivalent under certain conditions; this is what we expect from practice as the disciplines of geology, geochemistry and geophysics are not
Geocomputing Management 45 exclusive of each other. But once you start examining uncertainties you can demonstrate a geological system from a geophysical or a geochemical system, and the most important thing to take from Equation 3 is a geological computer system will reduce uncertainty by associating diverse facts.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 46
What are the key concepts? In considering geological computing from a classical context, I did not want to abandon the years of research into the theoretical logic of computing, called systems analysis, but at the same time I wanted to focus immediately on the rocks and not the computers. I liked the approach of White (1987 bbb) where he quickly maps management principles onto exploration activities, to gain his readers interest. In my case I see the steps in database design from McFadden & Hoffer (1991ccc) mapping across to the earth scientist’s thinking as in Table 3. This gives a framework to explain each of the geological computing concepts, and the conjoining specifications, mixing in systems analysis and geology as I need. Table 3 mapping database design steps to geological computing concepts steps in database design 1
GEOLOGICAL COMPUTING specification (geological equivalent) Step 1 - requirements definition STRATIGRAPHY requirements specification (stratigraphic systems) Step 2 - conceptual design EARTH MODEL information architecture (mathematical context) Step 3 - implementation design ORE SYSTEM application program specifications (application of geological computing) Step 4 - physical design NATURAL HISTORY COMPUTING SYSTEM NOTES 1 From page 168 of McFadden & Hoffer (1991ccc)
stratigraphy Stratigraphy, the logical arrangement of layers of rock in the earth’s crust, is the most important tool in dividing measurements into statistically coherent subsets. Brown (2011 ddd) gives that International Subcommission on Stratigraphic Classification (ISSC) considers multiple stratigraphies including multiple bio-, chemo-, sequence-, cyclo- and magneto-stratigraphy. In Table 4, there are several types of these systems of classifying rocks into packages or bbb ccc
Andrew. H. White, Management of mineral exploration (Moggill, Qld.: Glenside, S. Aust., 1997). Fred R. McFadden and Jeffrey A. Hoffer, Data base management (Redwood City, California, 1991).
ddd
Cathy Brown, 'International connections - current activities and future opportunities', The Australian Geologist no. 158 (2011), p. 12.
Geocomputing Management 47 groups in the ground. The only system which reflects events from kilometres down to the smallest size is the litho-stratigraphy that is the classical concept of a formation introduced many years ago by William Smith in the first geological map of Britain. Therefore while geochemists are more than happy to divide their analysis by rock type or lithology, and generate for themselves statistically reliable results, the geologist requires when the whole story of all the earth processes involved including those which act at a kilometre scale, then the results should be rendered on the basis of formation. The recognition of the primary importance of the concept of a formation in computer modelling is the single most important step for any computer geologist to progress from theory and the laboratory to working with clients for money in the field. The other elements of stratigraphy also have significant use in practical observation and are summarised in Table 4.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 48 Table 4 stratigraphic systems stratigraphic system (rock package) specific property of change litho-stratigraphy sequence stratigraphy 2 (system tract) depositional trend1 chrono-stratigraphy bio-stratigraphy 3, fossil content1 chemo-stratigraphy (synthem) 5 conformity magneto-stratigraphy 5 (magnetosomes) magnetic polarity 1 characteristics Time indicators Iso-chronous Y n P influence radius (of the surrounding rock) in excess of kilometres ? n n n Y Y kilometres P n n n Y Y decametres P n P Y Y Y metres Y P Y Y centimetres P Y Y Y Y millimetres Y Y Y Y Y LEGEND Y YES, n : no; P perhaps, partially or nearly; - beyond the limits of detection NOTES 1 from Embry (2003)eee: The importance of stratigraphy for computer modelling stems from what Embry calls “recognition and correlation of changes in a specific property of the strata” which is the basis of all stratigraphy and equally the goal of any computer modelling. 2 Embry refers to sequence stratigraphy as quasi-chrono-stratigraphy for constraining facies and interpreting depositional history: sub-aerial unconformity maximum flooding surface maximum regressive surface shore face ravinement 3 Embry remarks that bio-stratigraphy is harder and more costly to obtain than sequence stratigraphy 4 Embry suggests that chemo-stratigraphy and magneto-stratigraphy are very rare, especially for subsurface investigation. 5 Embry defines a synthem as a package of strata bounded by unconformities. 6 The rationale behind magneto-stratigraphy is discussed in detail in Brakel 2006fff.
mathematical context There could be as many approaches to geological computing as geologists, each with quite subtle differences that even to the Aston Embry, 'Coming to grips with sequence stratigraphy', The Australian Geologist no. 128 (2003), pp. 21-22. fff Albert Brakel, 'Magnetosomes: a new kind of rock unit', The Australian Geologist no. 141 (2006), p. 1. eee
Geocomputing Management 49 experienced reviewer are not apparent. However, in Table 8 I have put forward that there are three distinct types of earth modelling mathematics. Hirsinger (2008ggg) supports these thoughts providing equivalent descriptions of physical implementations for the application level, though differentiates the use of thesauri (Knowledge Based Linking) and graphical searching (Spatial Linking), though both applications use keywords and are mathematically equivalent [co-ordinates and geographic names are just digital codes to be sorted as far as the computer is concerned]. Table 5 relating three broad regimes of mathematics to geoscience application mathematics universal context spatial context spatio-historic context NOTES 1 Taken from the themes of Hirsinger (2008 ggg)
application level 1 Search Based Linking Knowledge Based Linking Spatial Linking Direct Linking
The first is the approach where no earth logic is used and the field measurements are considered to be equally significant and a fully empirical approach is taken. When considering two outcomes produced from these techniques, such as two drilling proposals, or two flood mitigation schemes, or two business plans, they are compared in a universal context that is all aspects are considered equally. This approach features in Table 6. Table 6 geological modelling in a universal context computing techniques strengths
weaknesses
ggg
data mining multi-variate analysis Google searches 1 No geologists needed for data analysis No geologists needed for data preparation. Superficial text based search links can be established without any extra data management 1 May 'discover' new relationships and information 1 Very slow with large volumes of data Gives all measurement techniques equal significance As it is fully empirical it cannot predict new deposit/event styles. Can only
Volker Hirsinger, 'Just give me the well completion report,' (Adelaide: Petrosys Pty Ltd, 2008).
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 50
general use
find overlooked deposits/events Further data collection does not necessarily reduce the uncertainty. Data preparation must be finished before start of analysis May 'obscure' important connections through 'noise' from irrelevant information 1 No guarantee that a given link will be presented when data is sought. 1 Enthusiasm for spatial searches and metadata may create a whole new – and costly - layer of data management 1 insurance companies financial institutions strategic analysis for government materials laboratories least squares regression in Sutherland (2005)hhh
case study NOTES 1 These are provided in a comparison of ‘Direct Linking’ to ‘Search Linking’ in Hirsinger (2008iii)
F. L. Sutherland et al., 'Belmore Volcanic Province, northeastern New South Wales, and some implications for plume variations along Cenozoic migratory trails.', Australian Journal of Earth Sciences vol. 52, no. 6 (2005). iii Hirsinger, 'Just give me the well completion report.' hhh
Geocomputing Management 51 In the second approach where, an attempt has been made through maps or a GIS to ensure that the model is spatially competent, any comparison between two proposals derived from that model is being considered in a predominantly spatial context. This approach features in Table 7. Table 7 geological modelling in a spatial context computing techniques
weights of evidence GISjjj
strengths
No geologists needed for data preparation. can predict unknown deposit/event styles Further data collection reduces uncertainty on specified outcome.
weaknesses
Geologist needed for data analysis need to ignore some data Is cumbersome for very large amounts of data. Can only be used for a single outcome Data preparation must be finished before start of analysis Cannot predict missing components (mineralogy, freak or collateral events etc), where there is no empirical evidence.
general use
geological surveys (exploration initiatives) academic institutions some exploration-only companies land managers emergency services
Fractal-dimension analysis1 in Hodkiewitcz (2005)kkk case study may be a cross-over between the two approaches of Table 7 and Table 8 and this is also recognised by the author who concludes the abstract with “Fractal-dimension analysis thus provides a link between empirical map features and the processes that have enhanced hydrothermal fluid flow and resulted in the formation of larger orogenic-gold deposits.” case study 1 This
However, geologists make comparisons of two areas on the basis of their geological history. A geological history considers both the position and timeliness of events or processes and so two proposals are compared in a spatial-historical context. Before computers was summarised in the geological cartoons like those of Table 2 in the previous section. This approach features in Table 8.
Joseph K. Berry, Beyond mapping : concepts, algorithms, and issues in GIS (1993). P. F. Hodkiewitcz et al., 'Complexity gradients in the Yilgarn Craton: fundamental controls on crustalscale fluid flow and the formation of world-class orogenic-gold deposits.', Australian Journal of Earth Sciences vol. 52, no. 6 (2005). jjj
kkk
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 52 Table 8 geological modelling in a spatial-historical context computing techniques
geological history holistic approach whole-of-earth model true 4D GIS
strengths
integrates very large volumes of data Analysis can begin while data is still being prepared. Predicts unconsidered deposit/event styles. model can be used for many activities, by many disciplines further data collection reduces uncertainty for all activities Are reproducible 1 Provide a confident way of exposing a known view of information 1 Encourage quality control and expose potential errors 1
weaknesses
Geologist needed for data preparation and analysis greatest cost and time lag in setting up requires planning Require significant investment in rigorous data management 1 Only present the relationships that the data managers know about 1 Are not good at dealing with vaguely defined information1
general use
companies involved in both exploration & production engineering geology consultants
case study
Climate proxies in Appleyard (2005)lll Thermodynamic modelling in Mason (2004)mmm Quantifying fault movement in Quigley et. al. (2006)nnn
NOTES 1. These are provided in a comparison of ‘Direct Linking’ to ‘Search Linking’ in Hirsinger (2008 ooo)
The computing for techniques used in a universal context, are well defined and documented by mathematicians. Similarly, geographers and surveyors have done a large amount of work on comparison in the spatial context, but there is very little on preparing computers for techniques working in a spatio-historical context, Geologists do use the other styles of modelling but the most successful, versatile and safe outcomes are achieved taking the spatio-historical approach. S. J. Appleyard, 'Late Holocene temperature record from southwestern Australia: evidence of global warming from deep boreholes ', Australian Journal of Earth Science vol. 52 no. 1 (2005 ). mmm D. R. Mason, 'Thermodynamic modelling of lode gold deposits in Archaen granitoids: Woodcutters and Lady Bountiful mines, Kalgoorlie region, Western Australia.', Australian Journal of Earth Sciences vol. 51, no. 3 (2004). nnn M. C. Quigley, M. L. Cupper, and M. Sandiford, 'Quaternary faults of south-central Australia; palaeoseismicity, slip rates and origin', Australian Journal of Earth Sciences vol. 53, no. 2 (2006). ooo Hirsinger, 'Just give me the well completion report.' lll
Geocomputing Management 53 They are consistently used by the field geologist, whether working on a mine, for United Nations flood mitigation, or a drainage plan for a sub-division and the rest of this guide will focus on this style of work.
earth model In Anonymous (2011ppp) the concept of a “shared earth model” was “well known”, but I will go through it here anyhow. The earth model in a geological sense is a collection (that is it is organised) of measurements (“numerical description” in Anonymous 2011) and represents the processes of the earth. It derives from the role of any professional geologist to make an assemblage of field observations that comply with the constraints (“abstractions” of Anonymous 2011) listed in Figure 1. ACTS REGULATIONS GOV’T GUIDELINES AS/NZS STANDARDS GEOLOGY MAPS COMMON-SENSE AND FREE ADVICE
Figure 1 the compliance pyramid I think of the items in Figure 1 as business rules, as they include both natural and man-made controls to the best extent that we understand or can interpret them. When implemented on a computer with the data loaded, and databases commissioned the earth model would be considered a computer system by computing professionals. This happens already in your thoughts and the organised data types given as examples in Table 9 will be familiar to you as documents, and illustrate the features of an earth model.
ppp
'RokDoc's role in facilitating innovation in exploration and production', PESA News Resources no. 109 (2011), pp. 57-60. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Table 9 components of a computer system used for natural history module before draft 18 LOGIC contains understanding CARTOGRAPHIC presents the data HISTORIC contain the observations ANALYTIC process the data
earth model after draft 18 LOGIC
Example of documents GIS, species chart, stratigraphic column
Example of standards Table 40 geodetic monitoring networks after Featherstone
GEOMETRY
CAD, plan, map.
Table 37 suggested projections by geographical context
ASTRONOMY
database, project management, mineral production, journal Geostatistics, graphs, crosssection plots and interpretation. Remote sensing, geophysical image, finite difference model. Internal report., open file report., initial prospectus offering (IPO.), archive
Table 51 recommendation for time axes versus action examples
Talk, poster
Table 78 popular IT management phrases and where you can find formal definitions
ALGEBRA
MUSIC
RHETORIC.or REPORTING summarise the data
GRAMMAR
RHETORIC
Table 52 mathematics for geological problems after Berkman Table 53 official height data.
Table 84 checks for the basic structure of an XML file
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
natural history computing system Computer systems used for natural history when considered as a lot are very diverse. Natural history can encompass at least history, geography, geology, biology and archaeology. Possibly, they could encompass every bit of software written. However, to the user, successful, well-used systems for these disciplines are different to commercial or engineering systems, distinguished by the the features in Table 9 to give a matrix of software like Table 10. Table 10 a matrix of software for Computers in Geology before the introduction of Google Earth prior to 2005
Initially I confined my thinking to just logic, cartographic, historic, analytic and rhetoric, which we had empirically found but this did remind me of the seven liberal arts and sciences introduced to me in masonic ritual, and in that ritual those seven themes are chained to the “researches into the hidden mysteries of nature and science” in the second degree workinga. The most obvious was that written reports were done in Microsoft Word which had a grammar checker and talks using Microsoft PowerPoint, including speaker notes narrowly defined the two arts of GRAMMAR and RHETORIC. In principle, seismic processing and sonic geophysical tools are associated with MUSIC given the large amount of signal processing used, but some of the other practices are not so obvious, such as where does the rock records recovered from a drillcore sit. By the 18th draft of this Grimoire I felt I could distinguish at least some Page 139 part of the S.E. Corner address in The ritual of the three degrees of craft masonry and investiture addresses, (Adelaide, 2004). a
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 56 applications which matched all the traditional divides of classical learning. In practice I found that a field geologist had to be a jackof-all-trades and I found myself integrating the work from other disciplines and being an interpreter between workers of those disciplines. This may reflect your own experience as the breadth of subjects in the Field Geologist’s Manual by Berkmang, suggest my career is not unique.
Table 11 natural history computing system for Computers in Geology circa 2010 APPLICATION (outcome & activity) I. Reconnaissance (research & cataloguing) II. Field work (field data and verification) III. Preparation of results (analyses & processing) IV. Project review (corporate information & data sharing) V. Proposal for further work (summary and presentation) VI. Reporting (archive & reporting)
GEO-COMPUTING MODULE logic DM
historic CinG search centre
algebraic
cartographic
MS Excel
Google Earth
CinG feldbuch.xls
reporting ISI R. EndNote MS Outlook
GS Mapper
MS Excel
CinG Tau model
CinG GeoTime3
GS Surfer CinG Intranet
G. FreeView 9
MS Word MS Outlook
MS Powerpoint ISI R. EndNote
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
MS Word
ore system Similar to an earth model the ore system in a geological sense is a collection (that is a systematic agglomeration) of processes that represent ore genesis (“reservoir simulation model” of Anonymous 2011a). Again when implemented on a computer with the algorithms approximating those processes and the controlling conditions estimated then the ore system is considered a physical model by computing professionals. The data for a geological system must necessarily be physical measurements but there are thousands of different devices and techniques and Berkmanb uses nine groupings: physical properties; gravity survey; magnetic survey; electromagnetic, resistivity and induced polarisation survey; radiometric survey; seismic survey; down-hole survey; airborne survey methods; and earthquake magnitude and intensity. To help decide what combination of components you want for any particular use, I have been keeping a record of archetypical applications I have come across, the series of case studies follows. A. B. C. D. E. F. G. H.
I.
is the entropy analysis in Mason lll is a treatment of Holocene surface temperatures in Western Australia with MATRIX 1.6 as per Appleyardmmm is an amalgam of mobile mapping from GIS User with three references: Fairall (2001)a, ‘GIS User: mobile computing hardware’c and ‘GIS User: mobile computing software’ d. is a discussion of aerial digital surveys by Fairall in 2004Error! Bookmark not defined. is monitoring Holocene coastal change in New Zealand with HallidayError! Bookmark not defined. is where luminescence and ASTER images are used to quantify fault displacement in Quigley et. alError! Bookmark not defined. is predicting sand drift with ThomasError! Bookmark not defined. is a discussion of three bases for terrestrial scanning. Given examples of time of flight scanners are Callidus, I-SiTE, Leica, MDL, Optech, Reigl and Trimble. For modulated i.e. phase-shift scanners are Iqvolution, Quantapoint and Z+F. No examples of triangulation scanners are given. The reference is Grieves (2004)Error! Bookmark not defined. Discussion of seismic and sonic techniques for modelling noise affecting marine animals in Hughes 2011e
a
'RokDoc's role in facilitating innovation in exploration and production', no. See Chapter 9 Geophysics of Berkman, Field geologist's manual. c 'Hardware for mobile mapping', GIS User no. 47 (2001), pp. 32-36. d 'Software for mobile mapping', GIS User no. 47 (2001), pp. 32-36. b
e
John Hughes, 'Seismic surveys and marine life: Why does the 'noise' mask the science and the industry experience?', PESA News Resources no. 113 (2011), pp. 36-41.
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 59
application of geological computing Geological computing, as specified by Long f for any information system, combines hardware, software, procedures and data. Long writing in 1988 also adds people, but in geological computing you don’t always have computer operators, examples being digital weather stations, satellites and rock-fall alarms. These basic components can be amalgamated in to other terms, such as the computer system (hardware + software as in Curtin g), and the computer application from McFadden and Hoffer h, which includes all other parts plus a use. A computer application will also utilise different instruments, which are continuously being invented so I don’t have a nice categorisation of those, though Long gives broad categories of input, output, processing, storage, and data communications. As adjunct to that I will just list the phrases annotated with any papers that review that use.
borehole imager j digitiser i dipmeter j geophysical borehole logs global positioning system (GPS) laser scanner, phase difference laser scanner, timed pulse laser scanner, triangulation mobile phone personal digital assistant/PDA k printer l seabed acoustic loggersm synthetic aperture radar/SAR 4
Page 14 of Larry Long, Introduction to computers & information processing, 2nd edition (Englewood Cliffs, New Jersey, 1988). g See Figure 1-1 of Dennis P. Curtin, Application software with Wordstar, TWIN/1-2-3, and dBase III Plus (Eaglewood Cliffs, New Jersey, 1988). h McFadden and Hoffer, Data base management. i 'Peripherals survey', GIS User no. 28 (1998), pp. 46-47. f
j
Lawrence Bourke Jeremy Prosser, 'Early dipmeters and new tricks with old dips - part 1', PESA News Resources no. 113 (2011), pp. 26-29. k Jon Fairall, 'Mobile mapping: What is it good for?', GIS User no. 47 (2001), pp. 27-31. l 'Peripherals survey', no. m
Hughes, 'Seismic surveys and marine life: Why does the 'noise' mask the science and the industry experience?', no. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 60
towed passive acoustic monitoring tablet computer
m
These keywords are from the case studies listed at the end of the previous section ‘ore system’ and which are also referenced in Table 12. In that table each case study is reviewed against category of algorithm and hardware, and referenced against the data group used. This ready-reckoner came out of demonstrating at the University of Melbourne in 2001. I found many of the Victorian Institute of Earth and Planetary Science graduate students were struggling to find processing to match up with what little data they had available to support their particular research topic: Table 12 and the web-page www.grantjacquier.info/clipart.html#algorithm are intended to meet that need.
Table 12 review of algorithm against geophysical measurement, processing and hardware geophysical measurement (after, Berkman, 1989)1 9.9 Earthquake magnitude and density 9.8 Airborne survey 9.7 Down-hole survey 9.6 Seismic survey 9.5 Radiometric survey 9.4 Electromagnetic, resistivity & induced polarisation 9.3 Magnetic survey 9.2 Gravity survey 9.1 Physical properties your situation tick the available data: Description of hardware used C, F, G B E,H Hardware 3 INPUT I D,I PROCESSING I D,I OUTPUT I I STORAGE DATA COMMUNICATIONS I I airborne laser scanner 4 E geophysical borehole logs B global positioning system(GPS) G X X X X X X X laser scanner, phase diff. H
tick
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 62
geophysical measurement (after, Berkman, 1989)1 9.9 Earthquake magnitude and density 9.8 Airborne survey 9.7 Down-hole survey 9.6 Seismic survey 9.5 Radiometric survey 9.4 Electromagnetic, resistivity & induced polarisation 9.3 Magnetic survey 9.2 Gravity survey 9.1 Physical properties your situation tick the available data: laser scanner, timed pulse H mobile phone F personal digital assistant/PDA a C tablet computer C processing category2 Fundamentals Sorting Algorithms Searching Algorithms String processing Geometric Algorithms C,G D Graph Algorithms Mathematical Algorithms E a
Fairall, 'Mobile mapping: What is it good for?', no.
Geocomputing Management 63
geophysical measurement (after, Berkman, 1989)1 9.9 Earthquake magnitude and density 9.8 Airborne survey 9.7 Down-hole survey 9.6 Seismic survey 9.5 Radiometric survey 9.4 Electromagnetic, resistivity & induced polarisation 9.3 Magnetic survey 9.2 Gravity survey 9.1 Physical properties your situation tick the available data: Advanced Topics A A B F LEGEND X : generic application to this component A - I : particular case study (application) in the ore system section above NOTES 1 These divisions are used by Berkman for his Chapter 9, Geophysics 2 These divisions are used by Sedgewick for his eight major parts 3 These divisions are used by Longd for parts of a computer system
b c
d
Berkman, Field geologist's manual. Robert Sedgewick, Algorithms (Reading, Massachusetts, 1988).
Long, Introduction to computers & information processing, 2nd edition. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Why not just buy the software? Geological computing is a great opportunity because for years’ accountants have controlled outdoor activity in terms of unnatural accounts, but if we could find some digital representation of the rock record we could put it together into one computer with all the business issues and against that put in all the relevant events in history and let it crank away to give really wise answers. Most recently, Mackiet (from surveys of oil exploration companies) has found empirically that the correct tools to judge these variables, which he labels ‘Fit-for-purpose tools’, will aid decision-making. I am not surprised; divination has been an ongoing interest to leaders in all societies. I think Figure 2, is a count of the software titles I have surveyed a to see if they can demonstrate the standard laws of geology. It suggests to me that there isn’t a single program to do this work, perhaps we can expect that in the next fifty years, and that is shown by the “ideal geological software”. For the time being you will have to cobble together several pieces to get the full coverage of all the laws of nature and produce sensible estimates for your design
a
The survey is available on my web-site at http://www.grantjacquier.info/home_files/softinfo.htm
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 65 13 geocomputing software titles in survey
ideal geological software law of priority
law of homonymy law of universal gravitation law of superposition law of stream gradients law of refraction law of reflection law of original horizontality law of original continuity law of faunal succession law of faunal assemblages law of equal declivities law of crosscutting relationships law of constancy of interfacial angles 0
10
20
count of software demonstrating this law law of nature
other law
These laws are taken from the entry for “law…” in American Geological Institute Dictionary of geological terms, 1976b. The survey is recorded in full on the ‘Computers in Geology’ web sitec.
Figure 2 count of software demonstrating the laws of geology
b c
Matthews and Boyer (eds.), Dictionary of geological terms. http://www.grantjacquier.info/home/softinfo.htm
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 66
How do I not waste my money? When I first became involved with computing I was surpised not only by how quickly new products were available as in Figure 3 but also the open deceit practised in the information technology (IT) industry. I was informed of the adage ‘that the difference between a used car salesman and computer salesman is that the used car salesman knows when he is lying’. However, I learnt that the changing technology could be used to step around problems and that the IT in the mining industry, worked on a basis of friendship and trust. The need for trust has been higlighteded recently in the empirical work of Mackiet on decision-making for geological situations. Unfortunately, I have developed some inappropriate national prejudice in analysing the information provided by vendors and now see the marketing in several styles, which have to be examined in the context of different weaknesses:
American marketing style Australian marketing style Nordic marketing style British marketing style
Geol. system
S/W science
S/W suppl. 2005 MRSPOTS
1999
1996
Fax machine
Ext. drive
hub
2008
ball scanner
1999 Colour print
1992
H/W field computer
printer
Track
modem
COGS’TH CD-ROM
Key board
modem
Backup device
LUMINIERE screen
H/W obs.
Photo copier
1992
B/W print
SARAH
Figure 3 a geological computer system marked with the date when components were integrated WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Understanding the strength in the American marketing style Australian mining software marketing will generally be based around the principle of mutual obligation and friendship. This philosophy is in contrast to American software/services majors who are much more aggressive. For example, a colleague brought to my attention the statement in Figure 4 from the web site listed as the first case study in Table 13, where the particular method of disseminating information is compared to other methods from other suppliers. Curiously, less than a year later from when I read Figure 4, Google Earth was released onto the market, which did achieve some of those objectives, but I never saw any similar blather, perhaps the hyperbole is itself a signal about the quality of the product.
‘ESRI has been selected by the Department of the Interior to develop the full implementation of the Geospatial One-Stop Operational Portal (GOS 2). This next generation technology represents a dramatic advance not only for geographic information system (GIS) on the Internet but also for the entire geospatial field. It will provide new ways of sharing geospatial information that will help improve the business of government and decision making processes’ Figure 4 an example of hyperbole from an American software developer This over-bearing attitude actually provides Australian developers with an advantage in that developing countries where most mining takes place are very sensitive to imperialistic attitudes and the friendly, straightforward Australian approach is more appealing and this may be one of the reasons that Australian mining software dominates the international market. However, I suggest a caveat that the Australian innovation ritual is only superior where resources are limited. This is supported by Gouldiea, who in petroleum exploration and development, proposes a co-operative approach with service companies when there are very few companies who can do a
T A Gouldie, 'To tender, re-negotiate or partner: Strategies for contracting service companies. ,' in APOGC 94 SPE 28745 (Houston, Texas: Society of Petroleum Engineers, 1994).
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 69 the work. Mackiet also backs him up from another direction by stressing the need for a team-based decision, or at least authentication (the “reduction of bias”), among diverse technical specialists. Table 13 marketing examples and commercial risk in geological computing case study 1 http://www.esriaustralia.com.au/company/pages/news/press/ http://www.smartconference.com.au/industryUpdate.php?id=142 Microsoft Excel 2003 Help Notes Golden Software Voxler trial disk 'It's about trust, Oracle' by Michael S. Malone. commercial hazard Insufficient documentation available 5 4 1 3 2 Software requires massive data preparation 5 1 2 4 3 Software can’t be used without extensive customisation 5 1 2 3 4 Targets government buyers to adopt software to control standards 3 1 4 2 5 Promise improvements when not available 5 1 2 3 4 Government to government influence 4 3 1 2 5 Suggest software will replace all other software 5 1 2 3 4 rating, sum of ranks (low is less risk, high is more risk) 32 12 14 20 27 NOTES 1 All these case studies refer to software companies which have their head office in the United States of America. RANK 1 : The software mentioned in the case study is least affected by this commercial hazard 5 : The software mentioned in the case study is most affected by this commercial hazard
The second URL in Table 13 is also another example of the marketing of a structured query language (SQL) database developer. The web articles in Table 13 are typical of the marketing style of the corporate software houses that target the more centralisationfriendly government departments in order to influence standards and lock in mining companies and other smaller organisations into their products. Malone’s is the only article I have come across discussing marketing tactics used to frustrate computer system development and is general, not Australian or geo-science specific. However, I have encountered several cases myself but they all are "Commercial and in Confidence" and can’t be discussed here but Malone's paper reflected the dissatisfaction that my client’s exploration computing staff had at that time with those products. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 70 In reflection the frustration with this type of marketing is a clash of cultures rather than anything illegal. I work with Ben Moretti who assigns an adage to his father (Franco Moretti, a former principal of Kinhill, CEO of the Alice Springs to Darwin railway construction, director of Beach Petroleum etc) that 'Australians do business as if they are at a barbecue, Americans do business as if going to war, and the English as if business were a public school'. The case of Golden Software in Table 13 illustrates an exception and it is also my feeling that Microsoft is far more even-handed and supportive, with customers and competitors who have become suppliers, than they are given credit for in the newspapers.
Understanding the strength in the Australian marketing style I attended the Software Marketing 97 course put on by the University of South Australia, which brought out professors Vijay Mahajan and Rajendra Srivastava, both associated with the 'hothouse' at the University of Texas used to develop ideas of researchers into start-up businesses. From what they described about the hot-house method, innovators with a new idea are supported by best-in-breed materials from established suppliers: HP, Texas Instruments, National Silicon etc; who are looking to expand their application base and increase their economy of scale. Perhaps, where this D-Day style of build up comes unstuck in Australia is that we don't have the range of these suppliers, and so they don't compete against each other to make the best use of an innovation introduced into the hothouse. What happens in Australia is the prime contractor takes over in a "she'll be right" attitude and they inevitably don't have the depth of technology to complete the expectations of the customers. Surprisingly to me with such wonderful companies on hand, Mahajan and Srivastava were openly critical of the American model deteriorating in this way, and preach 'love your customer' as a general remedy. They are supported in their prejudice by research discussing the limitations of American practice such as 'Loyalty and the Renaissance of Marketing' b and this follows the tradition established at least by 1912 with Dale Carnegie and his book “How to make friends and influence people”.
b
'Loyalty and the Renaissance of Marketing', Marketing Management vol. 2, no. 4.
Geocomputing Management 71 A particular and well published Australian case is the privatised telecommunications supplier Telstra and this situation was summarised by Fairall in 2009c. He states that “Telstra is effectively a monopoly because it has control of what telecoms engineers refer to as ‘the last mile’: the physical cable between the box in the street and the box on the wall inside your house”. Commenting on the company’s technical effectiveness “Telstra’s network is functional, but it is also obsolete. It will eventually make the Australian economy uncompetitive….every year that passes is a year of monopolistic rents, so Telstra’s strategy is to slow down any replacement process, using whatever means available”. Of course there is an American precedent for this when the Supreme Court broke up the Bell Corporation. Fairall does comment that “interests of Telstra’s shareholders are not the nation’s” yet the share price was reduced 25% when the Telstra management derided the National Broadband Network initiative of the Commonwealth government because I think it is, to those shareholders [including myself], not good business to treat your customers [also myself] with contempt. The American remedy of ‘Love your customer’ rings out loud and clear. The only other article I have come across on the Australian innovation ritual being superior to the British model but unfortunately again with a military example is "Diggers learned their way to glory" by Stephen Matchett in The Weekend Australian, which describes how Monash harvested the innovation talent within the AIF to break through on the Western Front. d These men were in competition both against the Germans but just as much against the prejudice of Europeans for colonial volunteers. So I can see that where Australian organisations abandon the quest for a monopoly enjoy the competition, and embracing their own abilities, the customer is well serviced.
Understanding the strength of the British marketing style A published case study on Australian innovation which discusses the underhand marketing of overseas companies, and also the friendly, mutual obligation between Australian developers and their customers c d
Jon Fairall, 'The Trouble with Telstra', Position Magazine no. 39 (2009), p. 7. Stephen Matchett, 'Diggers learned their way to glory,' in The Weekend Australian (Sydney: 2004).
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 72 (engendering niche development), is the history of the Commonwealth Aircraft Corporation Pty Ltd [a private enterprise which is often confused with the Government Aircraft Factory, but there was only a fence between them at Fisherman’s Bend, Victoria] by Brian L. Hill.e Hill gives several examples where British bureaucrats influenced, via Australian counterparts, the specifications for Royal Australian Air Force (RAAF) airframes and engines, which resulted in planes that were not quite the best available technology at the time. In contrast Hill describes that the RAAF had a very trusting and successful friendship with Wackett, the original general manager of the Commonwealth Aircraft Corporation [Wackett was an ex-RAAF fighter and test pilot, so he had their confidence from the start] that lead to several innovative aircraft particularly suited to Australian circumstances, but which also found sales overseas. Similarly, Neville Shute in his autobiography “Slide Rule” places the responsibility for the destruction of the R101 airship and the loss of the crew, to this culture of bureaucratic interference, and contrasts it to the supportive, traditional shop-floor culture used to build the R102. I don’t think that either of these authors are being unfair, as I saw for myself at the Harley Davidson centenary roadshow in Melbourne the pre-World War II letter from the commissioner of the South Australian Police, requesting an exemption from the federal government requirement to use BSA motor bicycles which the police found inferior to the Harley Davidsons they had been using. I can see the parallels to the IT situation but I don't think it would be clear to anyone else. I am confident that the mining industry has enough money and the construction industry has enough experience with the standards associations, to step around this kind of government to government interference, but I don’t think the Landcare groups are going to be able to disperse their environmental effort to keep the bureaucrats from enforcing an unsuitable IT regime. With my work on National Heritage Trust funding, I got the strong impression from reading the research briefs, that IT and data collection issues were being used as a way to enthral the catchment management authorities, without primary consideration being given
e
Brian L. Hill, Wirraway to Hornet, a history of the Commonwealth Aircraft Corporation Pty Ltd (Melbourne, 1998).
Geocomputing Management 73 to those councils. Jon Fairall, a former editor of Position Magazine, gave these points in his final editorial 2010f:
The spatial software and data products are being used more, and more widely. Software companies and bureaucrats will be brought to account for the weaknesses of their product (he gives the example of Department of Sustainability and Environment (New South Wales) and Spatial Vision and faulty information in bushfire maps in February 2010). Need improved ways of getting information that is speedier and correct. Perhaps a domestic satellite monitoring service is the answer. Perhaps crowd-sourcing of information [GJ : it works really well for family history software just look at www.ancestry.com and associated products including the TV series ‘Who do you think you are?”] The poor supply of information by government to carnavigation software manuafacturers. However, he does expect these to improve quickly as the suppliers are all in competition. Public enterprises with big companies dominate the Australian market, money is wasted, and not enough money is given to small firms who can accommodate the customer/public more quickly. On the future he sees Treasury officials being more aware of what is required and cosy-relationships will be broken down. It is now harder than ever for small start-up firms to make new products and break these technical log-jams. Even in practice, the price of full featured computer systems is driving out innovative smaller companies, despite that the surveyor and geologist are expecting to be independent. Professional training has improved and will get better, with more opportunities for life-long careers in GIS and cartography, though people come and go too often.
Jon Fairall also often commented obliquely on the aggressive marketing by American software companies. In an earlier 2007g
f
Jon Fairall, 'So long, and thanks for all the fish', Position Magazine no. 46 (2010), p. 9.
g
Jon Fairall, 'The Way Forward', Position Magazine no. 26 (2007), p. 7.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 74 editorial he gives this prediction, regarding bureaucratic interference both in public and private realms: “…Partnerships are indeed the way forward. But the industry is littered with attempts at partnerships between IT departments and spatial scientists – and the results are not pretty. For every happyever-after story there are a dozen dysfunctional workplaces where a multi-million-dollar IT system simply does not work.” He is critical of his own role and perhaps gives us an insight to what he really thinks (he reinforces this with his final editorial in May 2010h): “Search as you might, you will never find an article in Position entitled ‘The 20 Great Mistakes of Corporate Computing’. And of course, you will never find the sub-title of that article either: ‘What I learned from them’.” He implied that he is doing the best job of communicating; even given he had to pay the rent from software advertising revenues. Jon was very supportive of Australian industry and I think he did a good job too, though he may have been too pessimistic in the quote below, because I found to be trustworthy, the methods of Microsoft and Golden Software shown in Table 13: “There is no mechanism for sharing knowledge, and thus no mechanism for advancing it – except perhaps in some dusty academic tomb where the information can be safely sanitised and kept from the children.”
A little experience with the Nordic style of marketing There is also, in geo-computing, use of a Scandinavian model for innovation. The Western Australian Government is conducting an investigation into establishing a centralised Norway-style petroleum data bank. I haven't had a chance to look on their web site to see if they have produced any reports yet, and see how it is all going.
h
Fairall, 'So long, and thanks for all the fish', no.
Geocomputing Management 75 I did have a visit from a Norwegian professor, a very long way for him to come, who invited me for a drink and was discussing very competent software in which he has an interest, and was generally low key in his discussions. This may be the case of extreme marketing, you actually get to speak to the development manager face-to-face, but if Norwegian programs are as effective as Nokia phones, Volvo cars and Ikea furniture then we are in for some treats. The weakness of this approach was that I had to rely on a tip from a colleague, and I then wrote a formal letter to the company, so don’t expect in-your-face advertising, you have to tell these people why you want their product.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 76
When can I use a computer safely? There are a series of hazards involved in geological computing and dealt with in Table 14, my risk reduction check list, and the groups of hazards discussed here in order of seriousness: 0. Mine/field accidents (rockfall, vehicle roll-overs) while collecting detailed information for the database and other physical injuries. I also include repetive strain injuries and Legionellosis (Legionaire’s disease) in this category. 1. You become unemployed in a cyclic downturn, depression and other marital hazards 2. equipment failure or destruction 3. Computer viruses and other malicious activity including theft. I throw into this the white collar crimes of copyright violation and plagiarism. For most of those listed I have a paragraph on each to try and suggest directions to ameliorate the problem in the context of computer use. I originally thought that computing would be independent of mine and field accidents, but I have found there are often computing-related errors involved, such as: 1. The Air New Zealand crash on Mt Erebus, Antartica, where a clerk instead of a pilot typed the flight course into the computer (Stewart 2009i). 2. the 2010 Deepwater Horizon catastrophe reported by Caesar 2010j, which he describes as a “direct analogue of the Piper Alpha disaster in 1988”, with a “whole series” of problems, one of which was the “engineers’ inability to read a pressure test correctly” (PESA resource News 2011 k gives 11 men killed, 17 injured, 4.9MM barrels of oil lost). I think these are a subset of problems as discussed by Stapledon (in 1996l he also gives a computing example) where engineers don’t i j
Stewart, 'Sightseers doomed before take-off.' Ed Caesar, 'Blood, Oil & Money', The Weekend Australian Magazine no. (2010), pp. 10-18.
k
'US Regulator's Verdict in on Macondo', PESA News Resources no. 114 (2011), pp. 30-31.
l
D.H. Stapledon, 'Keeping the "Geo"; Why and How,' in 7th Australia New Zealand Conference on Geomechanics: Geomechanics in a Changing World, ed. M.B. Jaksa, W.S. Kaggwa, and D.A. Cameron
Geocomputing Management 77 take the necessary care in working with natural materials. I don’t treat these catastrophes here because better advice is available at the reception desk of your nearest department of mines. However, I have had opportunity to research and write up separate sections on hazards peculiar to computing:
intellectual property issues and data confidentiality a special “sealed section” on becoming so seriously boring you can never get married. Data theft Identity crime Legionellosis temperature and humidity stress
I have put together a few aids to prevent these. A diagram summarising the hazards, incidents and the overall risk is shown in Figure 5. The riskiest incidents are over-use injury (sometimes called RSI repetive strain injury) and vehicles damaging equipment, which correspond to indoor and outdoor, respectively. The risk analysis in this graph, Risk Assessment, is found in the sheet hazards of the StudEx.xls spreadsheet available on my web-site. Other odd things are that I attach all warning and warranty stickers to the lid of a notebook. I know this makes it ugly but it helps when I am in a panic and anything you do to make your notebook distinctive and ugly will discourage someone stealing it. At some later date you should get your driver’s licence number (pre-fixed by the first letter of your state) engraved on the body and the screen of the laptop to discourage thieves further and assist the police with recovering your goods.
(Adelaide, South Australia: New Zealand Geotechnical Society / Australian Geomechanics Society, 1996). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 78 amelioration none Max of risk injury, over-use injury, lifting fire strike a person Legionellosis
ag
gr e he ive av d y pe e r lig qu son i p h w at tnin me er g nt in s m a/ trike ov c d in u g ct ve s hi cl e
equipment damaged
incident 20.5-25.5 15.5-20.5 10.5-15.5 5.5-10.5 0.5-5.5 -4.5-0.5
hazard
Figure 5 plot of risks, for geological computing, by hazard and incident Occasionally the geologist is confronted with a dangerous situation, in particular working on hazardous mines like the King Island scheelite mine, the Moura coal mine or Long near Kambalda. Of course the more hazardous the more there is a requirement for detailed information to put into the computer to try and work out solutions. The exercise ‘A capital gains calculator’ gives guidance on how to prepare a fact sheet for the writing of a will. The same fact sheet doubles as documentation for applying for the dole (Newstart etc), a much more common and less permanent occurrence. If you do use the same form at least you get the social security department to desk check your will for nothing. The documentation has three parts:
A statement of expected capital gains for your investments in shares and projects A statement of liquidity, that is current amounts of any bank accounts Balance sheet of profit and loss for any business dealings
Geocomputing Management 79 Table 14 check list of system-design measures against hazard category HAZARD your hazard data theft Table 15 general data theft measures accidental death or injury Copyright and plagiarism Marital stress and unemployment etc. equipment failure or destruction 0
PREVENTION TYPE method
I
HARDWARE your purchase:
-
X
-
-
-
laptop/screen blocks
n
X
n
X
X
use laptops instead of desk tops
-
X
-
X
X
power surge protectors
X X
X
n
X
lockable filing cabinet
X
-
X
-
-
reports to clients not on display
X n
X
n
X
laptop leash
-
X
-
-
-
separate full-size keyboard
-
X
-
-
X
laptop cooling pad II
SOFTWARE your program:
X
-
X
X
-
X
-
X
X
X
use separate logins Table 25 anti-virus software III
PROCESS your process:
-
-
-
n
X
use dust sheets
X X
X
-
X
lock your doors and windows
X X
-
-
-
use copyright banners in scripts
X X
-
-
-
use copyright declarations on web-sites
-
-
-
X
X
computer advice to friends & family
X
-
X
X
X
Table 28 backup policy
n
-
X
X
X
Table 76 recovery plan
n
-
-
X
-
Table 85 financial facts
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
tick
Geocomputing Management 80 HAZARD your hazard data theft Table 15 general data theft measures accidental death or injury Copyright and plagiarism Marital stress and unemployment etc. equipment failure or destruction 0
PREVENTION TYPE method
tick
LEGEND X : this method is useful against this hazard - : this method is no obvious affect on this hazard n : this method increases this hazard I : this is the primary method of protection III : this is the least satisfactory method of protection
Intellectual property hazards About 2006, I had to get hold of the Geological Society of Australia’s ‘Code of Ethics’m for a careers night we were participating in at Norwood-Morialta High School, and as you do I had a quick read because I hadn’t looked at them for twenty years. I was struck by how relevant they were to the current computing situation. The usual thing: Article I.3 has “Honesty, integrity etc” which I have found essential for consulting and the expectation that you will be dealing with other people’s data. However, they got even more specific to geological computing, take Article II.2 which is a very current topic about re-use of data on the World-Wide-Web (consider Yahoo Pipesn if you want to understand more):
A geologist shall not knowingly permit the publication of his/her reports, maps, or other documents, for any unsound or illegitimate undertaking.
'Code of Ethics for Geologists,' ed. Geological Society of Australia Incorporated (Sydney: Geological Society of Australia). n To learn more about re-use of data on the World Wide Web, try the URL http://pipes.yahoo.com/pipes/ m
Geocomputing Management 81 The counterpoint to this, such as cutting and pasting blocks of text from an Adobe PDF (portable document format) file into your own Microsoft Word document is mentioned specifically in Article IV 2:
A geologist shall freely give credit for work done by others to whom the credit is due and shall refrain from plagiarism in oral and written communications, and not knowingly accept credit rightfully due to another geologist. When I talk to my solicitor I label these two issues as copyright and plagiarism. With copyright and plagiarism, it is not just a case of not doing it and keeping things confidential. Scientists want their ideas reviewed, so you have balance providing your ideas for discussion and publicising the worthy ideas of others, it really is our job. The tips I have found so far in order of usefulness: 1. Talk about your own situation with your lawyer 2. Ask him to write you a copyright notice that encourages readers to re-use your material and get your ideas out and about 3. Use a banner in your scripts giving copyright to your client if they paid for the time 4. Rather than use third-party web-sites like Panaramio to show your photographs in Google Earth, use KML files to link your photographs and keep both on your web-site, for which you have paid a monthly fee for the storage of your work, and your copyright is acknowleded in the agreement. 5. Keep a watchful eye on government departments as they feel they have a right to all material written about the earth under whatever act they feel gives them this right. I like to put banners on the top of scripts I have written for clients and Equation 100 has my usual banner. I did this out of routine and an opportunity to advertise but when questioned the other day about it I had a look at “Copyright” in Regan 1990 o which deals principally with the result of the Commonwealth Copyright Act 1968 under which this book is published, and which he prefaces with “The interest that vests the exclusive right to publish” and gives:
o
Regan, 'Copyright.'
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 82
Copyright subsists for unpublished original literary, dramatic, musical or artistic works of an author; literary works include written tables, compilations and dramatic works, scripts including those for films; a painting, sculpture, drawing, or photograph; computer programs, sound recordings, television and radio broadcasts. Where an original work is published copyright continues to subsist in the work. I noticed that that some other workers don’t put banners on their stuff and I thought “oh dear just another example of my pedantry”. However, in 2008 when Commander Communications Limited went into receivership they on-sold my contract to Peoplebank, and I realised for the first time the affect of the confidentiality clause as I was not to show the new managers what the old contract was about. If I had to demonstrate those scripts I had written under that contract belonged to my client it would be untidy because I couldn’t use the clause in the contract about passing the copyright without breaking the contract. So much easier to use the banner and demonstrate that I am meeting that requirement. Regan does emphasise the exclusive right of the author, but does this remain when dealing with the crown outside the commercial sphere. Position Magazine found in October-November 2008p that in August of 2008, the High Court of Australia ruled that” surveyors own copyright of their works, and that governments do not have an implied licence to use their material for free”. The article does finish with “Despite the court ruling, there is still a way to go before surveyors will receive any payment for use of their work”, so I am waiting to see what the practical results are. It was in this frame-ofmind that I reviewed another article in Position Magazine, where it described the efforts of the Ordnance Survey of Great Britain to prevent their data compilations being used in Google Maps because the Google Corporation was adopting the copyright. I am sorry I did not record the article, assuming it was more propaganda to defend the dominance of bureaucratic interests, as I had just read the Google conditions-of-use for my own purposes and did not consider what the OSGB were reported saying was a fair appreciation. Several months later ‘The Weekend Australian’ q reported something similar 'Surveyors Win Copyright', Position Magazine no. 37 (2008), p. 74. Michaela Boland, 'Google assumes a right to all books,' in The Weekend Australia (Adelaide: The News Corporation, 2009). p q
Geocomputing Management 83 for literary authors and the Google Books project. In this case Google Corporation was reported as requiring the onus to be on the authors to request the retention of their copyright, the reverse of what Regan outlined. So the debate continues.
Marital hazards It is my belief that all geologists have the personality and charm that echo Trollope’s eulogy to the Bendigo gold miners (circa 1873) r: However the boom/bust cycle of work, long absences, and artistic frustration can sour any relationship.
‘intelligent, manly and independent – altogether free from that subservience which the domination of capital too often produces … in no community are the manners of the people more courteous or their conduct more decent’ Despite my faith, it is a tradition in South Australia for the geologist to seriously consider the impact of their career choice on their marital prospects. The bleak and lonely semi-desert requires this and the song about copper mining in South Australia , ‘Blinman to the Top’, by Gary Atkins contains the lines “take your wife, if she’s prepared, to give up all, and venture forth” Despite being 150 years out of date, this verse still sums up the obligation required of a spouse [though this may be changing Ting s in 2009 stressed the cooperation of your employer]. This problem has been treated by other workers as well. Sprigg t devotes a whole chapter to ‘Should a geologist marry?’ in which he quotes the advice he was given in 1937 but still seems relevant with the retrenchment of field geologists in 2003 [and also 2009] i.e.:
Geoffrey Searle, The rush to be rich, a history of the colony of Victoria, 1883-1889, vol. 1883-1889 (Carlton, Victoria, 1970) p. 65. s Inga Ting, 'Advance Australia Fair?', Position Magazine no. 43 (2009), pp. 16-17. t Reg Sprigg, Geology is fun (recollections) or the anatomy and confessions of a geological addict. (Flinders Ranges, South Australia, 1989). r
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 84 “Get it into your skulls that all heiresses are beautiful” Whitei is more abstract with the chapter on ‘Motivation and Management’ but interaction with the spouse is mentioned again. I also feel of all the occupations for a field geologist, the least conversational is the study of computers AND rocks. There is the old fallback of learning to play tennis or joining the bush walking club but I have found that maintaining a good knowledge of Microsoft Word, and freely giving of that advice, gives you time with potential spouses. If you are co-habiting, consider setting up a user name for your friend on your own computer to prevent you spending more time fixing someone else’s machine than doing your own work. There is an also an old adage that an unskilled user will find the bugs faster than a knowledgeable user and it is always better to find these problems at home base rather than in the field.
Data theft I first researched identity theft, when I was concerned about a business asking for too much personal information, and read the alert regarding identity theft on www.police.sa.gov.au, the web-site of the South Australia Police. On a secondary issue but perhaps an even more significant business best-practice problem, geo-science data workers need to be really spot-on with data confidentiality if they want to provide computing technology to corporations reporting under the JORC code to the ASX (the Australian Securities Exchange) with the implications of insider trading (see Figure 6) I have done a detailed risk analysis on identity theft which I have included here as a separate sub-section.
Insider trading A term used to describe securities transactions undertaken by a person who stands in a particular relationship to the company in whose securities he or she deals and who has access to information which if generally available would be likely to affect the price of those securities (Corporations Act 1989 s 1002(1)) to the general public or the securities industry.
Geocomputing Management 85
Insider trading is prohibited under part X of the Securities Industry Code and under Part 7.11 of the Corporations Act 1989. Figure 6 definition of Insider Trading from Ryan (1990)u I suspect the principles of protection of the two types of data are similar, the only difference being that trading information remains valid (that is until it is reported) for a shorter period than credit cards and passports. If you exchange in your mind a photograph for a diagram of a drilling intersection (ASX release) or an audited financial statement (annual report), the work is the same. The Information Technology Contract & Recruitment Association has a definition of confidential information in taken from their code of conduct in ITCRA (2008v) with this encompassing view of confidential data.
“Confidential Information” refers to any information which may reasonably be regarded as confidential, or which was communicated in circumstances implying an obligation of confidence and, without limiting the generality of the foregoing, includes information relating to any dealings, trade secrets, transactions, or affairs of any Candidate or Client, and to any organisational or operational details. Figure 7 definition of "Confidential Information" from the ITCRA Code of Conduct, 2008 Generally you are considering keeping stock exchange reporting information confidential for months, where identity information will be current for years. More time to steal things the easier it is. Therefore, if your business can stop identity crime, it can stop insider trading. On that basis I have a single list of all the remedies for data theft in Table 15.
Michael Regan, 'Insider Trading,' in Australian Business Dictionary (Melbourne: Australian Business Library, 1990). v ITCRA, 'Code of Conduct, authorised by the Australian Competition and Consumer Commission 19 February 2008,' (Melbourne: Information Technology Contract & Recruitment Association, 2008). u
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 86 Table 15 a comparison of risk reduction for data theft hierarchy of control 1 BEST - eliminate substitute engineering/isolation administration / training WORST - personal protective equipment risk reduction activity your activity destroy or shred the document when no longer needed 2 don’t carry around extra or unnecessary documentation 2, 3 hire a post office box 3 Make sure your letter box is a suitable size 3 Never use recycling bins for confidential documents 3 lock up copies of documents Destroy document before putting in the rubbish bin 3 reconcile bank and account statements 2 be very cautious when giving information out on the phone 2, 3 ask questions about the security of the information 2, 3 Empty your letter box every day 3 Ask Australia Post to hold your mail when you go bush3 lock your letterbox 2, 3 cross the copy of the document you provide NOTES 1 from Mount Isa Mines (2001)w 2 from 'When bad things happen to your good name'x 3 from the South Australia Police web-site in 2009 y
X X
X X
X X X X X X X X X X
X X X X X X
X
Identity Crime I thought I should write on identity theft in this grimoire, because geologists are always travelling and using the Internet. The basic definitions from www.police.sa.gov.auz are quoted in Figure 8.
Adapted from materials supplied by Mount Isa Mines, Risk Management Study Guide (Rockhampton, Queensland, 2001). x 'Identity Crime 'When bad things happen to your good name' a guide to community prevention ', ed. South-Western Pacific region Conference of Commisioners of Police (2003). y South Australian Police, 'Safety & Security > Safety & Security Tips > Identity crime ' in Safet & Security 2009 (Adelaide: Government of South Australia, 2006). z Ibid. w
Geocomputing Management 87
What is identity fraud? Identity fraud is the use of a false identity to gain money, goods, services or other benefits. It can include the following types of criminal activity: counterfeiting credit cards, skimming (manually copying numbers or using a magnetic stripe reader) credit cards, the use of stolen credit cards or credit card numbers. False identities False identities are often established by: creating a fictitious identity by manufacturing or forging proof of identity documents, identity theft from an actual person (living or dead) by using stolen personal information or forged or stolen identity documents. What is identity theft? Identity theft is stealing your name for the purpose of obtaining money, goods, services or other benefits. This could include: opening fictitious accounts in your name at banks, credit card providers or department stores, accessing your bank accounts and credit cards. Identity theft often results in fraud by a 'takeover' of the victim's existing bank accounts or by the fraudulent operation of new accounts opened in the victim's name. Figure 8 identity crime definitions from the South Australia Police I didn't realise that the police in all the Australian states were so concerned ( the National Identity Security Strategy was headlined in Identity Security Branch, 2006aa) , though I was thinking the other day how older people could be tricked by the spam e-mails, I just hadn't made the connection that they would be getting all the complaints [Jefferson 2004bb uses the phrase “seeking assistance from the police to restore their good name”], I sort of thought it was a Telstra (the major Australian telephone company) issue. In October 2009, Detective Sergeant Andrew Bolingbroke, of the Attorney General's Department Identity Security Branch, 'Home > Crime Prevention and Enforcement > Identity Security,' in Crime Prevention and Enforcement, ed. Attorney General's Department 2009 (Canberra: Commonwealth of Australia, 2006). bb Judith Jefferson, 'Police and Identity Theft Victims - Preventing Futher Victimisation,' in Research Publications (Marden, South Australia: Australasian Centre for Policing Research, 2004). aa
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 88 Commercial & Electronic Crime Branch, kindly spoke to me, over the phone, about the responsibilities for employers or societies collecting personal information, and I made these notes.
You probably need to put lines through any images (to prevent them being used for fraud). He also commented that banks are sighting the documents only and not keeping copies because under the Federal antiterrorism act: if you have it, you have to hand it over, and then they can be sued. Don’t put images on un-protected disks and don’t send them through open e-mail Digital data/images are a concern to the Major Fraud Squad because they can be so easily sent overseas and out of their jurisdiction.
Southam (2009cc) extended his statement for other businesses as well with the advice of the Recruitment & Consulting Services Association (RCSA) to only sight documents with photographs even for such mundane practice as verifying a driver’s licence to use a work vehicle. After thinking about it, this not much different to any other hazard that we encounter and I can put together a risk analysis in the same way. To begin with I can see the magnitude of consequences differing based on the five types of documents in Table 17. This is a good practice in itself, Main and Robson (2001 dd) list the “weighting of documents into categories” in their Figure 3 ‘summary of registration and confirmation processes employed’. However, the different approach in Table 16 is taken from the South Australian identity theft acthh where all forms of identification are treated equally including personal identification numbers and alternatively the consequences vary if you are a minor, if you are trying to buy alcohol or enter licensed premises, or if you just attempt to, rather than produce, distribute or exchange the prohibited material, separate from actually committing the fraud or other criminal act. Subsequently this makes sense of why the
Kate Southam, 'Keeping photos not on,' in The Advertiser (Adelaide: Advertiser Newspapers Pty Limited, 2009). dd Geoff Main and Brett Robson, 'Scoping Identity Fraud, an abridged version of a report on identity fraud risks in Commonwealth agencies.,' ed. Attorney General's Department (Canberra: Commonwealth of Australia, 2001). cc
Geocomputing Management 89 Information Technology Contract and Recruitment Association have their code of conduct to supplement the legislation. Table 16 risk matrix for identity theft category of consequence use identity documents to commit another offence produce, distribute or exchange identity documents attempt to produce, distribute or exchange identity documents use to purchase proscribed drugs or enter licensed premises use by minor document storage method electronic or digital image 11 16 20 23 25 physical possession 7 12 17 21 24 notated facsimile 4 8 13 18 22 paper facsimile 2 5 9 14 19 sighting 1 3 6 10 15 NOTES 18 to 25 : High level of risk 6 to 17 : Medium level of risk 1 to 5 : Low level of risk
I can also imagine how the likelihood of a theft increases with the way that data is stored. Until I spoke to Det. Sgt Bolingbroke I would have put physical possession as being most likely opportunity for misuse, but the rating of likelihood after his advice is this: 1. 2. 3. 4. 5.
sighting paper facsimile (photocopy) notated facsimile physical possession electronic or digital image
Now with hierarchies of consequence and likelihood, the risk matrix, in Table 16, is straight forward, and matches those found in any mine or construction siteee. Then it is a matter of minimising the risk factor for any given responsibility. Table 17 consequences of identity crime type of consequence ee
Mines, Risk Management Study Guide.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 90
RATING
process Interruption financial cost personal injury, ‘damage ….caused to name and reputation’ 1 CATEGORY consequence
1
USE BY A MINOR embarrassment in the work place X 2 USE TO BUY ALCOHOL OR ENTER A LICENSED PREMISES exclusion from membership 2 X suspension from membership 2 X maximum fine AUD 5000 2 X reprimand or severe reprimand 2 X directed to obtain advice 2 ? X attend education courses 2 ? X pay expenses of investigation and disciplinary action 2 X publicise name and details of breach 2 X 3 ATTEMPT TO PRODUCE, DISTRIBUTE OR EXCHANGE as above X X X 4 PRODUCE, DISTRIBUTE OR EXCHANGE ID DATA as above X X X maximum imprisonment of 3 years 3 X 5 USE TO COMMIT ANOTHER OFFENCE credit card, bank or utility account as above X X X difficulty in restoring your credit rating 1 X X regain the trust of financial institutions 1 X valid passport especially a biometric one as above X X X LEGEND X : this type involves this particular consequence ? : this type may involve this particular consequence NOTES 1 these consequences given in ‘When bad things happen to your good name’ff 2 these consequences from ITCRA Code of Conduct (2008gg) 3 these consequences from Criminal Law Consolidation (Identity Theft) Amendment Act 2003 (2004hh) Consequences may be further sorted by these types of documents: i. personal identification number ii. birth extract/ birth certificate ff
'Identity Crime 'When bad things happen to your good name' a guide to community prevention
'. ITCRA, 'Code of Conduct, authorised by the Australian Competition and Consumer Commission 19 February 2008.' hh 'Criminal Law Consolidation (Identity Theft) Amendment Act 2003,' (South Australia: South Australian Legislation, 2003). gg
Geocomputing Management 91 iii. driver’s licence with photograph iv. credit card, bank or utility account v. valid passport especially a biometric one
Legionellosis, temperature and humidity stress In 2011, the year of the floods in Queensland and Victoria, increased water flow into the River Murray and the re-opening of the mouth in South Australia, my land lady arranged for the house to be painted, but first she had to get the “leak in the ceiling fixed”. It turned out not to be loose roof iron but water in the air-conditioning duct to my work room. The increased humidity had caused icing within the sealed evaporator unit and this was melting into the duct. This reminded me of the potential of diseases which be can be contracted by contact with water or soil such as Legionaire’s disease (or Legionellosis as used within this category by SA Health ii ) Malaria
Meningicoccal disease
Ross River virus infection
Tetanus
Gonorrhoea
Legionellosis
1000 100 10 1 0.1 2002
2003
2004
2005
2006
2007
2008
Figure 9 occurrences of selected notifiable diseases from South Australia (after Buckett 2009, Communicable Disease Control Branch Reportjj)
'You've Got What?,' (Adelaide: Government of South Australia, SA Health, 2009). Kevin Buckett, 'Prevention,' in Public Health Bulletin SA 6 (Adelaide: Government of South Australia, SA Health, 2009). ii jj
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 92 What is the likelihood of Legionellosis? An examination of Figure 9 shows that likelihood is in the order of the other water-borne disease Meningicoccal disease (sometimes contracted from under-chlorinated tap water) or getting malaria. From the geologist’s point of view: it is an order of magnitude less than getting Ross River fever in a wet year, but several orders of magnitude more likely than getting tetanus from a rock graze. Against the general background of all disease it is an order of magnitude less chance than getting Gonorrhea. So if using a condom every time is your average/medium likelihood, then there is a low likelihood. A quick check in Wikipedia kk shows that bacteria causing Legionellosis breed in the temperature range for computer operation (Figure 10), but rapid growth is limited to the 35 to 46 C range which is above operating temperature. I haven’t been able to find any guidelines for ducted air-conditioners, but if we assume the average romance routine is once-a-week, then once-a-month run the air-conditioner in the reverse cycle or leave the air-conditioner off in summer for several days, to dry those ducts. A heat wave should also do the trick as Wikipedia kk gives that at 55 C Legionellae die within 5 to 6 hours. If you don’t have the opportunity to turn off the air-conditoner then operate it at 18 C which keeps the Legionellae dormant. make, year
80
degrees Centigrade
60 40
max oper. T
20
max T min T
0 -20
Toshiba, 2005
HP, 2011
netbook, 2010
Legionellae
min oper. T
-40 -60
Figure 10 temperature tolerances for selected computers plotted against critical temperatures for Legionellae bacteria
kk
'Legionellosis,' in Wikipedia 2011 (Wikimedia Foundation, Inc, 2011).
Geocomputing Management 93 Generally, the health and safety warnings you have read in the leaflets accompanying a new system are straightforward and obvious. The only doubtful one is in regard to heat stress (see Figure 10) and dust on the computer, which you have to ignore to some extent. Generally, as suggested by the humidity range increasing in Figure 11 and the netbook in Figure 10, the tighter the device is put together the less likely that dust, heat or humidity will affect it: so I inspect the seams of any computer system I considering buying. make, year
% water vapour
100 max oper. humid.
80 60
max humid.
40
min humid
20
min oper. humid.
0 Toshiba, 2005
HP, 2011
netbook, 2010
Figure 11 acceptable limits for humidity in computer operation and storage
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 94
Where can I get a computer? I first used a laptop for my observatory computer when in 1999 I ordered a geological computing system based around a Hewlett Packard Omnibook 4150 laptop computer and an HP Deskjet 880C (the other specifics are given in the section for the “Luminiere” system). After I had depreciated that system and I shopped off-theshelf for a Toshiba Satellite M30 laptop with several printers. The Table 18 is a summary of the purchases with further descriptions of the historical computers in the sub-sections. If you want to replace an existing computer use Table 110 “the three main activities of moving to a new compter” in Chapter 4 DISCUSSION : integrating data:
The “Toffee” system, from 2016 The “Mitzi” system, used 2011 to 2016 The “MrsPots” system, used 2005 to 2011 The “Luminiere” system, used 2000 to 2005 Desktop systems used 1988 to 1999
The intention from the desktop days was that there was to be a field computer linked to the observatory computer. I have trialled a number of machines: Canon personal organizer, HP Ipaq, a Samsung mobile phone, and a Digital portable computer. Most recently, 2010 I tried a Dell netbook which is reported in the sub-section:
The “Chip” computer system, 2010 to 2015
From Table 18 you can see that I have been able to gradually desynchronise the purchase of the laptop from the other purchases for the system. The Toshiba Satellite and Hewlett Packard Envy series suitable for university and computer games playing; always have the compatible graphics systems for scientific charting. Care still has to be taken in purchase of connectors for hubs which will be dealt with in detail in the next chapter.
Geocomputing Management 95
Table 18 purchase types for previous systems of Computers in Geology TYPE OF PURCHASE “code” random access memory computer brand and model (multimedia unit) peripheral devices accessories AUD price OFF-THE-SHELF 1 “Toffee” 16384MB RAM HP Envy 17-r006TX (Direct X compatible) HDMI to VGA cable WordPerfect Office X8 Professional edition Bundle AUD 3 070 + “Mitzi” 1 Gigabyte RAM HP Envy 1100 (Direct X compatible) MS Office 2010 Professional … AUD 1 800+ “Chip” ? Gigabyte RAM Dell Inspiron min1012 (Direct X compatible) MS Office 2010 Home … “MrsPots” 1 Gigabyte RAM Toshiba Satellite M30 Floppy Plus card reader USB Port replicator Trackball HP Officejet 6500 S-Notebook backpack Notebook leash MS Office 2003 Pro AUD 5 300 CUSTOM ASSEMBLY “Luminiere” 128 Mbyte RAM HP Omnibook 4150 (NeoMagic MagicWave) HP Deskjet 880C MS Office + other software various desktop systems NOTES C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Microsoft Windows operating system
Intel CPU processing chip
2016 -
MS Windows 10
Intel Core i76700HQ
2011-2016
MS Win 7 Home Premium
Intel Core i5 M540 2.53Ghz
2010-2012
MS Win 7 Home
2005 - 2011
MS Win XP
Pentium M
1999 -2004
MS Win 98
Pentium II
1988 - 1999
MS Win …
80x86 chips
period of use
Geocomputing Management 96 1
Example vendors are listed in the StudEx.xls!comparison sheet found on my extranet at: http://localhost/C_IN_G/extranet/download.html
The “Toffee” computer system, 2016 to I included the WordPerfect Office X8 Professional Edition Bundle , purchased separately from the machinery, is better aligned with my work, and did not require a Microsoft Account. The plate on the side of the machinery box gave: HP ENVY Notebook 17-r006TX
6th generation Intel Core i7-6700Hq Processor (2.6 GHz) 2TB Hard Drive 16384MB DDR3 SDRAM DVD+-RW Optica Drive Windows 10 17.3” Diagonal Full HD IPS LED Display Intel RealSense 3D camera NVIDIA GeForce GTX Graphics WLAN & Bluetooth BANG & OLUFSEN
The things I compromised on:
No separate manual on the SD flash card 4-year warranty (though still better than “Mitzi” system) The documentation, though very clear did not say how long to leave the laptop on the charger in the initial period WordPerfect Office will only convert spreadsheet and word processing files, not the desktop publishing files from Microsoft Publisher (neither HTML nor *.pub file formats) WordPerfect Office though more powerful to do your own design, doesn’t have the pre-packaged design sets to the same extent as Microsoft Office professional edition.
Things I did like are:
Internet Explorer 11.51 has internal support for KML files embedded in web pages. So the Google Earth plug-in is not needed, as per https://developers.google.com/earth/
Geocomputing Management 97
Even more so the transition from VML clip art to SVG clip art has been effectively completed, and the vector-drawing
elements from HTML 5 pages can be dropped from Internet Explorer into Microsoft Word 2016. The
elements are also evident on the Telstra THub (Android 4.0.4 with Google Chrome 18.0), so HTML 5 is an effective standard for sharing geological cartoons. LiIon battery technology allows recharging without having to discharge completely. WordPerfect will edit Adobe Document Format (PDF) files Corel Presentation Graphics X8 will publish posters, documents and presentations as HTML files as well as PDF files. It is ideal for maintaining a web-site with the similar functionality from the Golden Software products. This was something that Microsoft Publisher 2003 had, but was lost in later versions. Corel AfterShot 2, also part of Corel WordPerfect Office X8 package, provided a separate image post-processor; whereas previously I had relied on the in-built Photo Editor from Microsoft Office 2010.
Things that caused me problems:
The additional software monitoring built into Microsoft Windows 10, becomes evident when having five or more documents open when doing the taxation summary. The machine becomes noticeably slower, more so than Windows 7 under the same load. Not being able to purchase Microsoft Office Professional, that is including Microsoft Access, and Business Contact Manager, in the one package. The usually reliable Golden Software installation process was causing errors “Installation ended prematurely because of an error”. The combination Microsoft 10 / Internet Explorer 11.51 did not work with census.abs.gov.au site. This may be a service problem for the web-site as the standard update for Telstra T-Hub (Android 4.0.4 with Google Chrome 18.0) was not suitable either.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 98 The most recent versions from Golden Software installed fine (Surfer 12 in my case), whereas MapViewer 7 gave the error (MapViewer 8 was available for purchase), and the knowledge base on the Golden Software web-site suggests this also for Didger 4 and other demonstrations. There is a known problem with SONAR function of Norton 360 virus checker and the downloaded software; but Golden Software support staff arranged for me to download the latest update of MapViewer 7 and the SONAR module didn’t interfere in either the installation nor the running of the package. To save the worry, download the latest update to your old system and save it to a C:\INSTALL directory before cutting across to the new system. I have always liked the way Golden Software package the release on CD, as the Internet connection can be unreliable in Australian regional areas where geologists work, but MS Office and Corel Office have moved to downloads for the Australian market. So I have introduced the c:\INSTALL folder into my procedures. The cautionary procedure above fits nicely into that method. Sabrina Pearson from Golden Software asked me to emphasise that there is a fall back position too:
In your guide, please tell users that they can always get the most recent version of whatever program they are using by contacting
[email protected] directly. They simply need to provide their serial number and we can give them download instructions. We do still ship CDs, but as you have found, that does not guarantee you the most recent version.
The “Belle” computer system, 2010 to 2015 The things I liked about the Dell Inspiron min1012 (rebadged as HP) are:
It has been set up to delete the supplied operating system and replace it with an alternative, for example Linux. The sim card from the Telstra radio modem can be inserted directly into the computer. Video camera LiIon battery technology allows recharging without having to discharge completely.
Geocomputing Management 99
The screen very good in daylight conditions
Things that I thought were weaknesses for this application. The difficulty of updating went beyond just the BIOS, I was forever restarting then waiting for the next support pack just keeping the operating system (Windows 7) updated:
19V charger system Difficult recovery disk generation Difficult updates for the BIOS 65C maximum temperature for batteries Not very clearly defined keyboard Pointing device was imprecise Screen was glary under electric light Keyboard was too small for proper typing.
The “Mitzi” system, used 2011 to 2016 My latest laptop is the HP Envy 1100. I chose it from several that complied with the minimum specification shown for 2010 in Table 19 because it had a:
a graphics chip compatible with DirectX the large 17.6 inch screen the gear was readily available at Officeworks the very small Imation USB2.0 Atom Flash Drive a full version of Microsoft One Note wrapped in the Office Professional 2010 software. The packing case the best sealed I have seen The user manual, including health and safety manuals is on SD flash card but there is also an option to automatically install these on the local disk, an option I used. The Quick Web application for quickly starting an Internet browser, rather than having to start up Windows all the way. The back-lit keyboard, including a switch to turn it off if you want to save power. The Microsoft Access exports the XML schemas as well as the data, plus an example XSL(T) template for displaying on the net, which saves an awful amount of time scripting these things up.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 100 The things I don’t like with the new observatory system are:
a 2-year warranty instead of 3 years, as a result of it being reduced in price on clearance sale., not getting Microsoft InfoPath, special data loading software in the Microsoft Office Professional package, the most upgraded package I could get. The CD/DVD drive cannot handle 8 cm compact disks (though there is a warning in the manual) The battery needs to be activated by turning on the computer with the power on even after fully charging it as per the instructions. This was not mentioned in those instructions. The Microsoft Office 2010 suite is quite radical compared to previous versions. I spent a lot of time converting existing documents which got corrupted when saving to the new version formats, and finding how things work in detail. The videos as part of the help system, rather than properly laid out help files that can you can speed read. The mirror finish on the display screen. In some light conditions I end up looking at myself not the open document.
The “MrsPots” system, used 2005 to 2011 The computer hardware I am using at the moment is from JB HiFi but with the MrsPots system You can still see my review of potential systems in the worksheet ‘Comparison’ in the Microsoft Excel spreadsheet StudEx.xsl [student examples] loaded on this web site. I bought the stuff from Officeworks, rather than a boutique supplier like LogiTech (who provided the previous system), because I was keen to see if I could do an off-the-shelf system: a complete geocomputer for around AUD 10 000, that anyone in Australia could purchase and setup. The accounting for this design, including the subscription costs excluded from that initial cost, are shown in ’parts’ and ’reckoning’ worksheets also in StudEx.xsl Howevwer, there were some problems with the MrsPots system, that would have been avoided with advice from a boutique supplier:
Geocomputing Management 101
The IOmega Floppy Plus drive and the Targus USB2.0 port replicator both give security warnings when installing the device drivers. This is mentioned in the Targus manual so I knew to over-ride it. The IOmega Floppy Plus, floppy drive does not work if connected to the port replicator, it has to be connected directly to the PC (also suggested in the IOmega manual). the automatic installation from CD of the Business Contact Manager (Office 2003) stalled, but was successfully installed when I went the through the ‘Add or Remove programs’ function in the Control Panel.
The “Luminiere” system, used 2000 to 2005 I had a custom-built system from Logi-Tech in Adelaide, and who will still do a nice multi-computer network for individual contractors/consultants. This system which was the first to replace the desktop systems I used in the late 20th Century, was comprised of:
HP Notebook 4150 PII 300, 32 MB SDRAM, 6.4 Gigabyte HDD, 1.44 Mb FDD, 32 speed CD ROM, 14.1” TFT Screen, Xircom 56Kbps fax/modem, PS2 two button Microsoft Mouse, MS Office professional, HP 880C Colour inkjet printer (12 months RTD Warranty), Warranty: 36 months return to base for notebook, backup Exec software with Seagate Travan TR-1 cartridge (400/800 Mb) , and other software of the time as suggested from the spreadsheet www.grantjacquier.info/develop.htm
The things I liked about the Hewlett Packard system:
The 3-year warranty and service in each Australian state and the two and half day turnaround to get a motherboard replaced, when I was in Melbourne.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 102
The ease of moving the laptop computer from office to home to university, it was even better than the Apple Macintosh 512, I had in the late 1980s. Being able to use the computer while travelling on the Overland train. The excellent printer drivers for the HP Deskjet 880C The LCD screen reduced eye strain I found Microsoft Wordpad superior to Microsoft Notepad for editing text files Being able to use the CD backup disks as archives or as data transfer disks as well. being able to let my girlfriend use the HP 880C with Macintosh Blueberry. The infrared connection to the university’s HP laser printers, saved lots of time having to set up network connections or hook up a parallel cable, when I did need to do a printed draft of a thesis. Being able to configure a separate simplified environment when my girlfriend wanted to borrow my computer.
Things I found I didn’t like:
the flat keyboard made typing more difficult unplugging all the different cables from the array of ports the sound card was not recommended for the Parrot headset, I received with the Dragon Naturally Speaking 5 software. Re-writable CDs were not worth the trouble of loading the Adaptec DirectCD software. They could only have a couple of backups before they were exhausted and couldn’t be used on any other machine except that which had DirectCD loaded and running. The USB Kodak CD-Writer stopping on me mid backup Problems reading Microsoft Write files in either Microsft Word 2000 or Microsoft Wordpad The big stack of backup CDs that I have ended up with. Not being able to upgrade the ISI ResearchSoft EndNote because the Microsoft Windows 98 operating system was no longer supported. Not being able to read my girlfriend’s USB2 thumb drive
Geocomputing Management 103
the intolerance to warmer office temperatures where there is no air conditioning, such as the university.
Desktop systems used 1992 to 1999 Previous to the laptop systems I had two desktop computer based systems which had the strengths of:
professional documentation secure packaging cheap good quality black and white printing from an Epson LQ-570 5.25” and 2.5” drives plus CD-ROM the reduced compile time for C programs on the 120 MHz Pentium CPU
The documentation and good packaging are important when you are going bush. The weaknesses of the desktop systems I found were:
a lack of disk space, heat stress affecting the calculations having to keep the machine running for receiving faxes *, unable to fax from Windows *, relatively primitive visual presentations, modem too slow for Internet facilities, I could not do colour brochures, the backups to Travan tape were not easily browsed and restored, having to limit my presentation files to less than 1.44 Mb so I could transfer them to the printer to Bridgehead to be converted to 35 mm slides or to Snap printing to be printed out as posters.
Subsequently, I bought a standalone fax-answering machine and this removed those problems marked with *. The Kodak CD-RW writer was purchased after the tape drive failed and was found more useful, so I never bothered to get the tape drive repaired. Everything else has generally been improved by adopting a laptop instead of the desktop system and colour inkjet printers instead of dot matrix. We may be in for another cycle of improvement as in the Hazards C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 104 section later in the book, where it is discussed that netbooks have greater environmental tolerances than laptops.
Geocomputing Management 105
Chapter 2 – METHOD: an ore system acts on an earth model In this chapter I expand on the concept of the earth model introduced in the previous chapter. To this end I use examples from the Eastern Goldfields around Ballarat, in Victoria, Australia. The model corresponds to the Ballart sheet regional geology map published by the Victorian Government. An earth model may have five computing components of
sub-system sub-system sub-system sub-system sub-system sub-system
for for for for for for
processing processing processing processing processing processing
Logic data Astronomical data Geometric data Algebraic data Rhetoric Grammatical data
So this chapter is about fitting the data for the Ballarat sheet into these modules ready for the ore system to be applied against it. Then that ore system is then examined in the light of the phases of an exploration cycle. But firstly I must build a common base for those processing sub-systems by choosing the equipment for a natural history computer system
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 106
Choosing the equipment for a natural history computer system This section is in the form of a specification for a new computer system based on my historical requirements, the outcome of which was shown in Table 18 purchase types for previous systems of Computers in Geology of the previous section. Do not be frightened to innovate for a geologist’s personal computing system as described by the hardware and software listed in this section. In a number of cases there are graphs to help predict future capacity and aid the selection of central processor unit etc. If you want to replace an existing computer use Table 110 “the three main activities of moving to a new compter” in Chapter 4 DISCUSSION : integrating data: To help you find your own computer sytem, an audit sheet with the minimum computing specifications is in Table 19. These are determined by considering the requirements for software being used at that time. The following sections give anecdotal evidence from past systems and my web-site has pages dedicated to the calculations and quotes for computer systems:
www.grantjacquier.info/develop.htm (specifications tab) www.grantjacquier.info/StudEx.xls (comparison sheet)
However, from my experience with desktop, laptop and now netbook computers, I have generalised a shopping list of components in Table 20 on the environment of use. Then each of the components is described in further detail in the sections that follow discussion of environment of use.
Geocomputing Management 107 Table 19 minimum specification for a new computer system RESTRICTION Your requirement
tick
my options
year
OPERATING SYSTEM your requirement1: Microsoft Windows 7 (+ support pack 1) Microsoft Windows XP
2016 2010
Microsoft Windows ME
2005
DISK SPACE your requirement1: 4.4 Gigabyte + 3 Gigabyte + folders 12 Gigabytes
2016 2010
9 Gigabytes
2005
PROCESSOR CAPACITY your requirement1: Intel Pentium III 1Ghz with SSE2
2016
Intel Pentium III 800 Mhz Intel Pentium III 500 Mhz
2010 2005
your requirement: 1 Gigabyte of RAM
2016
512 Megabytes of RAM
2010
128 Megabytes of RAM
2005
VIDEO CARD your requirement: Direct X9 (1280 x 800 Super VGA screen resolution) 32 MB DirectX compatible
2016 2010
1024×768, 16 bit color
2005
NOTES 1 Please see my website www.grantjacquier.info/develop.htm “specification” tab for examples and a recommendation
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 108
Environment of use My business is providing special computing services to the mineral and petroleum industries. This includes system and program development in Microsoft Windows, as well as site investigation and research. The laptop PC to for this work will be used to do:
software development general office administration client database and report archive maintaining financial accounts writing reports and theses creating presentations and posters demonstrating software desktop publishing of newsletter and advertising pamphlets maintaining a web page
The laptop PC will be situated in an office, hotel room, train carriage or convention centre with mains power but not necessarily airconditioning. Temperature and humidity limitations are treated in Figure 10 and Figure 11 of the Hazards section, later in the book. To complete the usual nominated environmental constraints, I have altitude in Figure 12, which hasn’t ever been a consideration in my work, but other geologists conducting air surveys may be interested. I think Figure 12 does indicate that computer manufacturers are making computers more suitable for carrying in the holds of aircraft by improving the maximum altitude at which they can be carried.
Geocomputing Management 109 make, year
metres above sea level
15000 13000
11000
max oper. alt.
9000
max alt.
7000
min alt.
5000
min oper. alt.
3000 1000 -1000
Toshiba, 2005
HP, 2010
HP, 2011
Figure 12 laptop computer air pressure tolerances I have generalised a shopping list of components in Table 20 on the environment of use. Then each of the components is described in further detail in the sections that follow discussion of environment of use.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 110 Table 20 shopping lists for a geological computer system 0
COMPONENT specification
A
need
no.
LAPTOP OR NETBOOK your item: Table 19 minimum specifications Table 27 suggestions for processing components Table 30 connection ports
B
C
D
SOFTWARE Table 26 software to be supplied with the hardware Table 24 utility software against function Table 25 computer virus-protection for a laptop Table 21 special software PERIPHERALS Table 28 current backup policy your item: 3G modem USB hub with ports as per Table 30 WiFi Hub (Ethernet capability) 11g/n as in Table 30 Table 31 check list for an observatory printer MISCELLANEOUS your item:
I I I I
1 1 1 1
16 GB USB drive for recovery disk I 2 security cable as per Table 14 I 2 notebook cooling stand as per Table 14 II 1 notebook back-pack II 2 Uninterruptible Power Supply 1 III 1 Dr PC service III 1 LEGEND I : must be present II : should be present III : could be present as it is nice to have NOTES 1 Please see my 2004 reviews of unterruptible power supplies (UPS) for the Australian Geoscience Technology web-sitell 2 Please see my website www.grantjacquier.info/develop.htm “specification” tab for examples and a recommendation
ll
Grant L Jacquier, 'Uninterruptible Power Supplies,' 2004 (Jacquier, Grant Leslie, 2004).
tick
Geocomputing Management 111
Software modules The application software used in the ‘Çomputers in Geology’ computing system is based around the concepts in Table 21. You may be surprised but this table was only filled in with the addition of Google Earth in December 2007. Up until then the slot occupied by that software was listed as ‘by hand on mylar over photos & maps’. The introduction of Google Earth is a good example of the adage of an applied scientist of “twice the cost, ten times the functionality”. With Google Earth the same marked up photograph can be displayed at ten (or more) different scales and there is even algorithms built-in to make sure your pin marks don’t overcrowd, as well as your photo is endless from one side of the earth to the other. Also from time to time the photography is updated all without disturbing your plotted marks. The following sections are the three lots of software which need to be considered with every purchase of a computer:
operating system software Software for finding computer viruses software required to be supplied
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 112
Table 21 software for the ‘Computers in Geology’ computing system APPLICATION (activity)
GEO-COMPUTING MODULE logic historic algebraic
Reconnaissance (research & cataloguing)
DM
Field work (field data and verification)
CinG feldbuch.xls
Preparation of results (analyses & processing) Project review (corporate information & data sharing) Proposal for further work (summary and presentation) Reporting (archive & reporting)
CinG search centre
ISI R. EndNote MS Excel
GS MapViewer CinG Tau model
cartographic rhetoric
Google Earth MS Outlook
MS Excel
GS Surfer
MS Word
CinG CinG Intranet G. FreeView 9 MS Outlook GeoTime3
MS Powerpoint / MS Publisher
ISI R. EndNote
MS Excel
ISI R. EndNote MS Word
The vendors for Table 21 are given in Table 22, but this itself is only a summary of the full list of software employed. The full list can be found on the Computers in Geology websitemm . Table 22 major vendors and key to Table 21 Principal vendors CinG
Computers in Geology
DM
Data Metallogenica (web site)
GS
Golden Software
Google ISI R. MS
Google ISI Researchsoft Microsoft
mm http://grantjacquier.info/develop.htm#software
Geocomputing Management 113 G.
Geomatica
operating system software The minimum acceptable operating system is Microsoft Windows ME, or preferably better. This is also true for anti-virus software which comes bundled including a free update licence but I prefer to buy my own and I discuss this in following section on anti-virus software. Other optional operating system software is covered in ‘utility software’.In summary any computer package should also include the graphical, machine and application interface software namely: i. ii. iii.
Microsoft Windows An HTML and Java browser for Internet applications. Drivers for the peripherals
Recommendations for device drivers are given Table 23.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 114 Table 23 drivers for additional devices category response question mine universal serial bus (USB) Floppy disk drive Model Iomega Floppy Plus Driver name: CITIZEN X1-USB Floppy Driver date: 1/07/2002 Driver version: 1.0.01 universal serial bus (USB) hub Model USB Composite Device Driver name: CITIZEN X1-USB Floppy Driver date: 1/07/2001 Driver version: 5.1.2600.0 Digital Signer Microsoft Windows Publisher Printer Name Deskjet 880C description: HP Deskjet 880C version: 5.1.2600.2180 manufacturer: HP
tick yours
Optional utility software Apart from the basic operating system Barnes 1989qq gives five features of additional utility software plus examples, required for a geologist, as given in Table 24. Barnes only allocates Microsoft Windows to one category, but gradually over the years it has taken up many of the functions he employed other software for. Additionally software accompanying or bundled with Microsoft purchased products such as Microsoft Internet Explorer, Microsoft Active Sync and Microsoft Script Editor, while maintaining the theme, have greater functionality than the software specially purchased by Barnes in his time.
Geocomputing Management 115 Table 24 utility software against function functionality of utility software 1 Operating system organisers File managers backup and archiving software communication software menu system software your need: software name Adobe Quicktime (on making of Australia CD-ROM) Le Menu 1 Microsoft Internet Explorer 2
X n -
-
Microsoft Active Sync 2
X
Dragon Naturally Speaking 3 Fastwire II 1
X n
Laplink 1 Procomm
n n
1
Microsoft Windows (XT and later)
-
-
-
Alloy/Novell 1 PKARC 1
n n
Sytos 1
n
-
Lister 1
n
Microsoft Word 1
X
Norton Utilities 1 Table 35 script editors 1, 2
X X
X
Table 25 anti-computer-virus software LEGEND X still superior to the Microsoft Windows offering - the standard, usually Microsoft Windows n was good in its time but now superseded by modern Microsoft Windows NOTES 1 from Barnes, 1989nn 2 this software comes bundled with Microsoft Office or other valid Microsoft licence 3 I reviewed this software for the Australian Geoscience Technologies web-siteoo, though I have gone back to the Microsoft offering Julian F. H. Barnes, 'Exploration computing in a small company environment. ,' in Computers in Exploration - Where we are now and where we are going, Seminar No. 7, Australian Institute of Geoscientists Bulletin No 9 (Perth: Australian Institute of Geoscientists, 1989). oo Grant L Jacquier, 'Dragon Naturally Speaking 5 - Preferred Edition,' (Parkside, South Australia: Computers in Geology, 2003). Ibid. nn
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
-
X n X
Geocomputing Management 116
Software for finding computer viruses Barnes states that “software utilities comprise, in general, a group of programs which are designed to make the MS-DOS environment as efficient as possible” and this is very true of anti-virus software. To addresse the hazards of computer viruses, Trojan horses, identity phishing etc. etc; I have found that subscription to a conventional virus checking service has been adequate but I have developed some buying preferences which I have given in Table 25, an assessment form, but introduce here. My favourite anti-virus software was the original Vet software which provided rescue disk and software on a monthly basis, just drop them in the box with your backups and that is your disaster management plan. The Symantec product featured all the utilities from the Norton utilities program, plus a web-site for rescuing your computer; it would do the scans from there. Norton Internet Security (netbook) software with a licence code for a years updates, available off-the-shelf at Officeworks, is provided on a USB thumb-drive which made it very easy to install on a netbook, (and later on my notebook, when the AVG subscription runs out) and can be stuffed into the documentation folder for that computer. So it is not all the fancy detection algorithms that influence me when selecting virus-checking software but rather the features I like are:
Provided software disk for reloading when your system does go down Routines to generate Rescue disks Extra utilities to fix files and handle corruption Nominating a file or folder to be checked when I need it Getting updates over the Internet but only when you are connected and the computer is idling
The annoying disadvantages I have found is interference with the running of software (Trend Micro and Norton 360), interfering scheduled disk scans (AVG), requiring registration on the web-site with passwords and e-mail addresses even though you have paid the money, have a license number and loaded the software which knows
Geocomputing Management 117 where to look for the files (both Symantec products and Trend Micro) and abusing the automatic update by sending advertising (Trend Micro). I don’t understand why the updating on the Internet has to be so intrusive, when you consider that the time signal from time.microsoft.com does something similar and a lot of people wouldn’t even know that their calendar and clock are being updated. I think it has been slowly improving after the backward step from mailed disks, and I found that I couldn’t notice the updates from Norton Internet Security (Netbook Edition) which features intelligent downloading for people on the move in airports and the like, so it is even superior to the disk based system of Vet. On data being taken from your computer I was surprised that in the 2009 upgrade of the AVG software that the conditions of use included a clause allowing for automatic sampling of files from your hard disk and return to the virus centre. This may go down well in eastern European countries, but this undermines your data theft procedures for research (intellectual property), society (identity theft) and JORC reporting (insider trading) businesses. So I retained the old version of AVG and won’t be considering their software until their work method changes. After it was looking like things were getting worse, I felt there was a general improvement with the release of Norton Internet Security, Netbook Edition. This still required file sampling, in the license they wrote
“4. Privacy Data Protection From time to time, the Software may collect certain information from the computer on which it is installed, which may include: … Portable executable files that are identified as potential malware … Such Automatic submission function may be deactivated after installtion by following the instructions in the documentation for applicable products.” Norton Internet Security (Netbook Edition) illustrates another feature I like with all the rescue, scanning and installation software on a USB drive that can be put in the “panic folder” of instructions ready for when you do have a failure. The plain version Norton Internet Security does have the software and scanner on the CD-ROM, but Vet was even better as it made a special rescue disk with C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 118 specifications of the computer all on there as well. They were not the first to think of this it was something found in the original Norton Utilities which carried across to the Symantec Norton 360 software. So in summary the things I don’t like in a virus checking software are:
Unauthorised file sampling Password registration e-mail marketing intrusive processing and messaging not coping with disconnection from the Internet
Geocomputing Management 119
Table 25 satisfaction matrix for virus-protection for a laptop Date:
software functions (installation is in Table 126 operating system activation details) Minimising interference during the day while you are working Rigmarole in updating the virus patterns e.g. being able to just enter the new licence key and keep the installation disk in the wrap More obscure product so not deliberately targeted by hackers a. b.
Supplying a rescue disk and clean-up utilities clean-up software plus system details to whatever media you have. clean-up software on USB or the lesser option of CD-ROM Supplying software on disk for disaster management submission of sample files to the vendor
Your criteria: Virus checking service name a perfect score:
rating 48
Your service Vet by Vet 75% 6 8 7 8 5 Norton Internet Security, Netbook Edition 60% 3 7 4 4 7 Norton Internet Security 6 5 2 Vet by Computer Associates 50% 5 3 6 6 1 Trend Micro PC-cillin 50% 7 5 3 5 3 AVG via Laser IT (here in Adelaide) 45% 2 4 2 7 6 Norton 360 by Symantec 40% 4 2 8 3 2 McAfee’s 1 25% 1 1 1 1 4 1 the McAffees software, one of the original releases, became bundled with Microsoft Windows.
8 7 6 5 2 3 1 4
software required to be supplied There is software that will be re-used for the new system, so there is no need to get a quote on it, and is mentioned here for completeness only. If you think there is a conflict with the other parts of the specification, please let me know. The list and system requirements for all software are listed on the Computers in Geology
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 120 web-sitepp. The software to be supplied is Microsoft Office including MS Word, MS Excel, MS Outlook and MS Access as per Table 26.
Table 26 software to be supplied with the hardware computer:
date:
item
SOFTWARE CATEGORY need1
quotation2 OK incl. sep. m y m y m y 0 SOFTWARE THAT IS ASSUMED TO BE SUPPLIED NORMALLY operating system2 I X utilities I X image editing software II Internet Browser I ? 1 PRODUCTIVITY SOFTWARE TO BE PURCHASED Microsoft Word I X Microsoft Excel I X Microsoft Outlook (O+) I X Microsoft Publisher (B+) II Microsoft PowerPoint I X M. Business Contact Manager (B+) II Microsoft Access (P+) II Microsoft OneNote (H+) III Microsoft InfoPath (U only) III 2 UTILITY SOFTWARE TO BE PURCHASED computer virus checker as per Table 25 I X version Microsoft Office suite, most modules at top: 2003 Office Ultimate (U) 2007 Office Professional (P) 2010 Office Small Business (B) other: Office Standard / Office Home and Business (O) Office Home and Student (H) 1 NOTES 1 Microsoft Office Home and Student is not available for commercial work 2 Minimum requirements can be surveyed with Table 19 minimum specification for a new computer system
pp
http://www.grantjacquier.info/develop.htm#software
Geocomputing Management 121
System Hardware I choose a Microsoft Windows based machine because most engineering, most surveying and a good deal of specialist geoscientific software runs on it. Also Microsoft Windows machines are supported more widely in rural Australia, so if I need maintenance or assistance while working in the bush it is more likely to be available. Alternatively, running on an Apple Macintosh (Mac) just isolates you from the best software, because if the Mac software is any good the software developers can afford to port the code to the Microsoft Windows environment and cash in on the economies of scale. Some of the heavy weight processing software still runs best on Unix or Linux but each year the major developers are porting more of their modules to the Microsoft Windows environment, to leave just the processing and data management core on the Unix server. As for any concerns of Microsoft hegemony, a scientist should be concentrating on the scientific issues of his data and application, not worrying about networks, printers, screen selection, disk management or even the usability of, or fatigue from the screen interface. If there is a need to change in the future the accountants, engineers and bank clerks will be changing as well, so do whatever they do. The modems come in two types, one for around the office use making a local area network (LAN) and the other for connecting outside the office making a wide-area network (WAN). 1. 1 x modem for WAN use. This modem must be suitable for connecting to an Internet service provider, as well as third party bulletin boards. It would be of benefit if I could also connect to the modems (+2400 baud) of my clients’ mainframe computers. It would be nice if the modem was also able to send faxes. 2. 1 x modem for LAN use to access a Siemans Speedstream 9671 WiFi , 100/10baseT Ethernet hub. The hardware in Table 27 must run the above software effectively. Where possible I have given indication of the minimum requirement but please ask the vendor for advice on the suitability.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 122 One integrated visual display unit is required including video card to be able to support at least 1024×768, 16 bit color (SVGA?) mode. The PC should also have a Windows compatible sound card and integrated speakers. A VGA port for attaching a second screen or projector is required. A nice to have is the digital TV receiver, as this gives you access to local weather and entertainment without increasing the amount of gear you take into the field. The other components discussed are:
Chip set Secondary storage Data backup device Ports local-area-networks (LAN) Modem and wide-area-networks (WAN) printer
Geocomputing Management 123 Table 27 computer components (central processing unit) 0 A
B
C
D
E
COMPONENT specification CENTRAL PROCESSING UNIT 1 your item:
need
no.
additional RAM DirectX compatible graphics chip nVIDEA graphics compatibility mathematics logic chip MULTIMEDIA COMPONENTS your item:
III I III III
1 1 1 1
integrated speakers web-cam digital television tuner SECONDARY STORAGE1 description hard drive SD card drive SD card drive microSD drive CD-ROM compatible drive CD-ROM 8 cm DVD R/W compatible drive MODEM your item:
I I III
1 1 1
min. size 13 GB 2 GB 8 GB 16 GB 640 MB < 640 MB 4 GB
Table 30 connection ports fax capability V90 modem & facsimile inbuilt 3G modem OTHER your item:
security cable connector (Kensington lock) 2 year service guarantee 5 year service guarantee sub 12V charging LEGEND I : must be present II : should be present III : could be present as it is nice to have NOTES C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
min. speed
16x 4.7 GB
need I II III III I III I
no. 1 1 1 1 1 1 1
I II III
? 1 1
I I II III
1 1 1 1
tick
tick
Geocomputing Management 124 1
miminimums can be surveyed with Table 19.
The chip set for the computer Barnes in 1989qq, explained that for a geology office there should be one or two computers, with the highest clock speed affordable, and at that time that was at least 16 MHz, he preferred the Intel 80386 16-bit processor; plus an arithmetic chip [actually built into that model, but before the 386 it had been an expansion option, that is why he mentioned it]. The random access memory or RAM was to be calculated by examination of the software, there were to be as many ports as possible (a minimum of two parallel and two serial). To this specification I would add: check the power supply. The Toshiba Satellite M30 laptop computer has a 15V DC power supply, and I think all Toshiba models have this specification. It would be better for a field geologist if the computer could be run on 12V power supply from the cigarette lighter connection in a Land Cruiser. Lesser voltages are no worry as there are plenty of adaptors around to step down the voltage to 9, 6 or 5 volts, but I have only seen one to step it up to 15V and that was at the stand of specialist marine electrics stall at a boat show. Also I am not concerned that the current supplied from the car battery would have to be higher, because you can either install a heavier duty battery or add another battery in parallel as often is done for two-way radios. As we often have to drive such long distances to get to site, there will not be a problem recharging the car batteries at the end of the day. In short form the update of the specification I used in 2005 for selection of the Toshiba Satellite M30 and then later for the Dell Mini 10 netbook is: a minimum of 128 Megabytes of RAM 1x CPU with at least an Intel Pentium III, 500 Megahertz microprocessor or better. The prediction from Figure 13 suggests between 2 and 4 Gigahertz. The serial/parallel port capability either directly as had been the case in the previous HP OmniBook, or as a USB hub.
qq
Barnes, 'Exploration computing in a small company environment. .'
Geocomputing Management 125 12 V or less internal battery power supply and the Li-Ion type allows to recharge without first discharging the battery completely. The operating system and application interface should also be supplied. prev ious chip
netbook
Pow er (prev ious chip)
processor frequency (MHz)
y = 9E-186x
41.116
100000 10000 1000 100 10 1 0.1 Jan-80
Jan-90
Jan-00
Jan-10
time (y ears)
Figure 13 the increasing speed of the micro-processor chip for geo-computing There must be a minimum of 128 Megabytes of RAM as per the items listed on the Computers in Geology web-sitepp. However, the MS Office software is probably the most demanding and if necessary requirements should be modified upwards to account for the latest versions of the productivity software. For the Toshiba Satellite M30 system in 2005 the additional Legend RAM was installed in-store, but there is a trick, you have to put it in at forty five degrees and then push the board flat. This component also failed under heat stress in 2007.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 126
previous chip
netbook
Power (previous chip) y = 1E-196x43.383
RAM capacity (Megabits)
100000 10000 1000 100 10 1 0.1 Jan-80 Jan-85 Jan-90 Jan-95 Jan-00 Jan-05 Jan-10 time (years)
Figure 14 RAM capacity for geo-computing
secondary storage Barnes in 1989rr, explained that for a geology office there should be one or two computers, with 5.25” and 3.5” floppy disk drives, and for the hard disk he asked for the “largest affordable (at least 60 megabytes)”. He noted that you should check for fast response time as the hard/disk/operating system interface is “main cause” of slow computer response. At that stage he recommended asking for a voice coil type, but nowadays you would be hard pressed to find one that wasn’t of that type and the continuing development of optical disk drives for recording and playing movies has pushed the specification of disk drive motors beyond what I need to care about. Disk capacity still needs to be considered with the minimum of 14 Gigabytes, as the sum of the capacity for the software items from Table 21, plus data storage of several components (see the audit in Table 125, the disks for the recovery in the order they are needed): rr
Ibid.
c:/archive1, 639 MB, 323 files, 8 folders c:/archive2, 641 MB, 729 files, 37 folders
Geocomputing Management 127
c:/holding3 (less than 640MB) C:/archive4, 4.23 GB, 1328 files, 2 folders C:/DOCS, 159 MB. 155 files, 14 folders C:/DATA, 3.29 GB, 6745 files, 453 folders plus an estimate for Settings and Profiles
This suggests the minimums shown in Table 27. As a check, just consider the measurements of disk capacity taken from previous specifications in Figure 15, which suggests that the system will require in total 500 Gigabytes (100 Gigabyte for data, 400 Gigabyte for software) by 2020. working data
software
music
Power (working data)
Power (software)
disk capacity (Megabytes)
1000000 100000 10000 1000 100 10 1 0.1 Jan-80
Jan-90
Jan-00
Jan-10
Jan-20
time (years)
Figure 15 previous disk capacity specifications
data backup device This device must be able to backup large portions of the hard disk without repeated changing of the media. Appropriate software must be supplied that enables restoration of data in full, by individual directories, or selected files. It must have the capacity of at least 150 MB. I have used in the past a Seagate Travan TR-1 cartridge drive (400/800MB) with Backup Exec. After problems with the drive I C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 128 replaced this with a Kodak CD-R/W writer, which I then changed to use with with CD-R disks with the policy shown in Table 28. Discussion of the two aproaches is expanded on in:
Read-Write archive disks CD-R for archives and backup
Table 28 current backup policy using a range of materials location 1 sequence Table 73 nomogram for backing up to USB stick and DVD monthly (week 1) 1 month on-site CD-ROM tray bi-monthly 2 month in transit or offsite storage 2 3, 4 & 5 month on-site CD-ROM tray half-yearly 6 month offsite storage 2 7, 8, 9, 10 & 11 month on-site CD-ROM tray annual 12 month offsite storage 2 13, 14, 15, & 16 month on-site CD-ROM tray 17, 18, … 23 month boxed on-site bi-annual 24 month offsite storage 2 25, 26, … etc boxed on-site half-decade 60 month offsite storage 2, 3 decade 120 month offsite storage 2, 4 1 All these disks have indefinite retention policies, except the Travan tapes and floppy disks. Since 2007 DVDs have been used in preference to CDs. 2 I currently use a Commonwealth Bank safe deposit A- size tray. 3 Travan tape. 4 3½ floppy disks. backup name
CD-R for archives and backup This policy is less intensive than the one that Barnes (1989) ss gives in his Table 4, which is a schedule for daily backups to a set of 9 tapes and would suit an active multi-geologist office. Unfortunately with my scheme, the number of disks I am holding in total is about 50, but I multiplex my time between projects and it could be years before I detect an error for which I wish to restore an alternative.
ss
Ibid.
Geocomputing Management 129 By 2007 I had switched to burning DVDs as the amount of material had grown especially with my flat-mates audio files. Potentially, USB thumb drives may provide a better solution but at 2005 the price of a full backup series was prohibitive. I thought the following sequence may replace that shown in Table 28. This would reduce the number of disks stored by 80% and increase the frequency of backups: One larger drive to take, week1, week2, week3 backups to be kept on-site Five smaller drives to take month 1, month 2, month 3, month 4, month 5 backups, which would be rotated off-site. six-monthly backups would be to CD-R to provide the halfyearly, annual, bi-annual, half-decade and decade backups.
Read-Write archive disks I initially thought that a Zip-Disk or Syquest drive system would be considered an advantage as it can be used to transfer image files to a printing bureau as well. However, I tried using CD-RW disks but I found that there wasn’t enough disk space for more than two passes and the inconvenience of only using them with Adaptec DirectCD software, rather than on any PC, discouraged me from further use. The DVD Super MultiDrive will enable you to use the 8 cm CD-R disk which was the substrate for the credit card CD. The Toshiba had these; but the first HP Envy did not, but the second one I purchased in 2016 did.
USB drives Where I did find that thumb drives came into their own is carrying data with you. In 2001 I had a credit-sized CD-ROM with medical details in my wallet. I found that it cracked even faster than my credit cards, so for that purpose I switched to USB thumb drive on my key-ring. The one medical file changed to the whole administration folder, then additional folders of work I had been doing, and in July 2009 I was able to put the whole data tree onto a single 2 megabyte drive that had been given to me as a promotion by Paradigm Geotechnology. The additional advantage is I always C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 130 have curriculum vitae and other critical files with me. I am particular about the design of the cap because I have found pocket fluff in the plug cavity where the cap falls off or it is one of those types which swing around on a frame. I adjusted Table 28 to show the use of these, initially with Table 29, and then for the semi-retired situation using Table 73 shown later in the book. Table 29 weekly backup cycle for USB drives backup name week 2 week 3 week 4
sequence weeks work folders c:\DATA weeks work folders
location
1
USB drive on key ring 2 GB USB drive in packet 2 x USB drives on black string
Computer ports and a local-area-network (LAN) The equipment in this section is for connecting things around the site, making a local area network (LAN). Barnes 1989 tt addresses the requirements for this equipment, which at that time included switch boxes and cable communication as separate items:
Check if it is telecom approved Essential - allow linking of two computers to one plotter Preferably serial connectors
For my current system this is principally done via WiFi transceiver and modem to access a Siemans Speedstream 9671 WiFi, 100/10baseT Ethernet hub. Though there are the simpler port based alternatives The LAN connections I have used have been, in order of improvement (though this is utility rather than speed as you can see from Figure 16): I. Floppy disks II. Null-modem cables and like (Barnes 1989 gives Fastwire II, Laplink) III. IEEE1394 iLink port, infrared port IV. Taurus USB (universal serial bus) hub tt
Ibid.
Geocomputing Management 131 V. Intel PROset for Wireless, an internal card in the Toshiba Satellite notepad, for 801.11b/g WiFi (2.4 Ghz) to match the Siemens Speedstream 9671 VI. 100/10 Base PC-MCIA card Ethernet VII. 100/10 Base T internal Ethernet card Table 30 ports for a hub, computer or printer A
B
C
GENERAL ITEMS description min. size min. speed USB port standard 1.0 USB port standard 2.0 USB port mini 2.0 USB port (SATA disk) standard 3.0 WiFi transceiver IEEE 803.11 g ( 2.4Ghz ) WiFi transceiver IEEE 803.11 n WiFi transceiver IEEE 803.11 ac Ethernet port RJ45 100 BaseT Ethernet port co-axial 100/10 external microphone port 3.5 mm (mini) x 15mm external speaker port 3.5 mm (mini) x 15 mm TRS headset port 3.5 mm (mini) x 15 mm TRRS h.s./multimedia port 3.5 mm (mini) x 15 mm SD/MMC photo card slot 2 GB SD/MMC photo card slot 8 GB SPECIFICALLY FOR A NOTEBOOK/NETBOOK OR HUB specification 3½ floppy disk drive 1.44 MB 5¼ floppy disk drive 1.2 MB Travan TR tape drive Television co-axial port serial port wired (RS-232) parallel port wired (Centronics) USB-B (input) HDMI connector (input) VGA port for an external computer screen Blue-Tooth transmitter infra-red port wired COMPUTER ONLY specification IEEE 1394 (Firewire/DV/Sony i.LINK) port for video camera (100Mbit/s) HDMI port (output) Kensington lock port
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
need
no. 3 2 1 1 1 1 1 1 1 1 1 1 1 1 1
tick
I I III III I II III II III I I II III I II need II III III II III III I I I II III
no. 1 1 1 1 1 1 1 1 1 1 1
tick
need II II I
no. 1 1 1
tick
Geocomputing Management 132 LEGEND I : must be present II : should be present III : could be present as it is nice to have
More than just ports
kbaud (1000 bytes per second)
For the LAN, Barnes quoted Fastwire II, Laplink but I held off on any special intra-office connections until 2000. I then had the opportunity of using the University College Ethernet network for printing and Internet browsing, at the cost of a PC-MIA card. This is still the ultimate solution, but is only suitable for a formal office or bachelor pad where you can leave the cables lying around. As for the home/office or rental situation: in 2007 I purchased a Siemens Speedstream hub with 801.11g WiFi capability. This was supported by the replacement of the previous printer with a Hewlett Packard Photosmart printer which also supports 11g.
100000
1000
10
0.1
Ethernet
WiFi/Bluetooth
Figure 16 modem speeds for LAN: Ethernet, WiFi (or Bluetooth)
Geocomputing Management 133
Modem and wide-area-network (WAN) The modem is for connecting outside the office making a wide-area network (WAN). Current equipment includes: 1 x modem for WAN use. This modem must be suitable for connecting to an Internet service provider, as well as third party bulletin boards. It would be of benefit if I could also connect to the modems (+2400 baud) of my clients’ mainframe computers. It would be nice if the modem was also able to send faxes. Barnes 1989uu addresses the requirements for this equipment as “Check it is Telecom approved”. At that time this category included switch boxes and cable communication as separate items. In contrast to delays for the internal networking I bought into the external networking by 1992. Initially I used the PSTN dial-up recommended by Barnes but in 2007 moved into Broadband with the purchase of the Siemens Speedstream with ADSL2+ capability. On occasions in the early 1990s I did dial-in into my clients computers with the PSTN, but in 2007 I began using a web interface (via the PSTN service overlain with TCP/IP software) to Santos Limited’s network, with Citrix Metaframe to optimise the screen refresh, and I would be surprised now if I had a client who did require direct dialin, but it remained my auxiliary service. By 2009, the poor service record of Telstra required not only ADSL2+ but also a NextG/3G radio connections, such as Telstra MF626, wireless modem. At that time, a falling gum tree removed the cable connecting the Telstra service and the work to replace it took over two weeks. A pay-asyou-go system got me back on-line to service my client. I heard from David Sebastyan at Saros Pty Ltd that they too had experienced such a break in service, along with others in their building, when a an optical fibre cable was cut. Now with the HP Photosmart C7280 multi-function printer having facsimile capacity via WiFi, with the convenience of not having to disconnect the telephone line every time I move the notebook, the modem/fax card is no longer a musthave component. Purchases have been, again in order of improving capability (but not speed as you can see from Figure 17 ):
uu
Ibid.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 134
kbaud (1000 bytes per second)
I. Maestro 9642XR fax/data modem; from the Maestro Fact Sheetvv: Group III facsimile utilities; for data Bell 103 (300 baud), 212A (1200 baud), CCITT V.22 (1200 baud), V.22bis (2400 baud), V.29 (9600/7200 baud) V.27ter (4800/2400 baud), V4.2 error correction, MNP class 2-4 error correction, MNP 5 data compression. II. Xircom credit card modem 56, PC-MIA fax/modem III. Toshiba internal card, international V90 modem + fax IV. Telstra MF626, USB wireless modem, WCDMA (3G): HSDPA/UMTS 850/1900/2100 MHz; 2G: GSM/GPRS/EDGE 850, 900, 1800, 1900 MHz. HSDPA mode (download) up to 3.6 megabits per second, UMTS mode (upload) up to 384 kilobits per second, EDGE mode up to 236.8 kilobits per second, GPRS mode up to 57.6 kilobits per second.
1000
100
10
1
0.1
PSTN (dialup)
3G upload
3G download
ADSL2 up
ADSL down
Figure 17 modem speeds for WAN connections: PSTN, 3G, ADSL2+
printer As late as 1989, Barnesqq was recommending that separate plotters for maps and printers for reports were required. He reckoned that a 'Maestro 9642XR fax/data modem,' ed. Maestro Communications Pty Ltd (Fyshwyck, Australian Capital Territory: Maestro Communications Pty Ltd, 1992). vv
Geocomputing Management 135 plotter should be capable of ISO A1 or A0 size paper, use Hewlett Packard Graphics language (HPGL) for compatibility with exploration software. Problems to test for included slow pen speeds which would slow down drill hole labelling. A printer should feature fast dot matrix, wide carriage, graphics compatible and ideally have colour printing. Since that time I have found the portability; the ease of purchase of colour A4 printers, the supplies and maintenance for them; outweigh the benefit of the convenience of broad paper formats. The software program Microsoft Publisher 2003 allows you to make a A0 poster and then print it off on a A4 colour sheets complete with crop lines to re-assemble it, a technique I used for a poster at the 2006 Australian Geological Convention and I was more fascinated by the construction than the contents. However, if you do have a relationship with a computer aided drafting (CAD) supply company, the modern Hewlett Packard Designjet series, which use sophisticated ink-jet technology, have overcome all the problems of wet ink and pens and are a delight to use. The requirements that I expect for a printer are in Table 31. Some of my experiences with individual models are below that with:
HP Deskjet 880C HP Photosmart C2780 mulit-function Canon Bubblejet
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 136 Table 31 check list for an observatory printer 0 I
II
III
NECESSITY capability
tick
MUST HAVE colour graphics printing better than 360 dpi printing separate colour and black cartridges Microsoft Windows drivers A4 report printing SHOULD HAVE in-built flat-bed scanner/photocopier InkJet printing technology double-sided printing HP graphics language capability SD/MMC photo card slot NICE TO HAVE in-built facsimile transmitter 35mm film and slide scanner CD printer wireless networking photograph quality printing > ISO A4 map printing wide-paper printing for data dumps
Hewlett Packard Deskjet 880C The Hewlett Packard (HP) Deskjet 880C printer I purchased in 2000 proved ideal for the work I undertake and I held off replacing it. Any replacement had to have at least 360 dpi printing, do graphics, mailing labels and be cheap to run. Previous to the 880C I had an EPSON LQ-570 bought in 1992, which was very rugged, is still running, and ideal for taking into dusty field offices. However, the quality of the printing was less than average and I wanted be able to do colour brochures direct from the printer, hence the 880C. In 2008, the HP880C stripped the teeth off the timing band. I replaced it with a HP Photosmart C2780 All-in-one printer, fax, copier and scanner.
Geocomputing Management 137
Hewlett Packard Photosmart C2780 Multifunction printer As well as the specifications below the HP Photosmart C2780 printer, purchased in 2008, has the benefit of 11g wireless networking; double-sided printing; and making photographs using a universal serial bus (USB) cable direct to a digital camera or plugging in 6 different format camera memory cards (CF, XD, SD, MMC, MS/DUO). The printer lasted just over a year and 800 pages, with a failure of the HP2 type printer head (“Error 0xc19a0013 Ink system has failed“). The print specifications from the manual are: Up to 1200 x 1200 rendered dpi black when printing from a computer Up to 4800 x 1200 optimized dpi color when printing from a computer and 1200-input dpi Print speeds vary according to the complexity of the document Panorama-size printing Method: drop-on-demand thermal inkjet Language: PCL3 GUI Duty cycle: Up to 3000 printed pages per month The photocopier specifications from the manual are: Copy resolution up to 4800 x 4800 Digital image processing Up to 99 copies from original (varies by model) Zoom to 400%, fit to page (varies by model) Copy speeds vary according to the complexity of the document The specifications for the scanner function of the printer are:
Image editor included Integrated OCR software automatically converts scanned text to editable text (if installed) Twain-compliant interface Resolution: up to 4800 x 9600 dpi optical (varies by model); 19200 dpi enhanced (software)
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 138
Color: 48-bit color, 8-bit grayscale (256 levels of gray) Maximum scan size from glass: 21.6 x 29.7 cm (8.5 x 11.7 inches)
The specifications for the facsimile function of the printer are:
Walk-up black-and-white and color fax capability. Up to 110 speed dials (varies by model). Up to 120-page memory (varies by model, based on ITU-T Test Image #1 at standard resolution). More complicated pages or higher resolution takes longer and uses more memory. Manual fax send and receive. Automatic busy redial up to five times (varies by model). Automatic no-answer redial one time (varies by model). Confirmation and activity reports. CCITT/ITU Group 3 fax with Error Correction Mode. 33.6 Kbps transmission. 3 seconds per page speed at 33.6 Kbps (based on ITU-T Test Image #1 at standard resolution). More complicated pages or higher resolution take longer and use more memory. Ring detect with automatic fax/answering machine switching.
Table 32 resolution for the HP Photosmart printer Photo (dpi)
Very Fine (dpi)
Fine (dpi)
Standard (dpi)
Black
200 x 200 (8-bit grayscale)
300 x 300
200 x 200
200 x 100
Color
200 x 200
200 x 200
200 x 200
200 x 200
Cannon Bubblejet In contrast to my own preference for Hewlett Packard inkjet technology my family have a predilection for the Canon BubbleJet series. They are much lighter, smaller and can sit on the desk with the computer. They found the ink canisters dry up too quickly in a semi-arid climate, and also the reservoirs are too small, needing replacement too often, which in both cases required a journey of an hour or so to Port Augusta. The drivers that come with the software aren’t as customised for the Canon system as for the HP or Epson printers, so often the quality of graphics is not as nice. They
Geocomputing Management 139 eventually bought other printers and I now have both a colour and a black Canon BubbleJet but they sit in my shed unused.
Manuals, servicing and maintenance support Hardware drivers, such as in Table 23, should be supplied on CDROM or 3.5” disks as well as the hard drive. A full manual set is required including: a system user guide, MS-DOS manuals, MS Windows manuals, modem documentation, printer manuals, monitor and video card documentation and any hardware driver documentation. This should allways arrive in the first case but later when you dispose of the computer, transport into the field or send it in for service you may vary the packing list as per Table 33.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 140 Table 33 packing lists for different activities action Moving the observatory or receiving the equipment Travelling to a conference or site Sending the computer for maintenance Disposing of a computer 0
CATEGORY item
1
2
3
4
tick
DOCUMENTS (from your folder) old, expired licence agreements
n
n
n
Y
Promotional brochure
Y
n
n
Y
Printer instructions
n
n
n
Y
Safety instructions
Y
?
n
Y
Safety manual and addendums
Y
?
n
Y
Computer manual and addendums
Y
?
n
Y
Warranty statements
Y
n
?
Y
Kenwood lock instructions
n
n
Y
Y
Mouse or trackball instructions
n
?
n
Y
ADSL cable instructions
n
?
n
Y
Joystick instructions
n
?
n
Y
USB hub user guide
n
?
n
Y
Panic sheet
n
n
Y
?
CABLES Modular RSJ45 modem cable
Y
n
Y
Y
Power cord
Y
Y
Y
Y
Power transformer
Y
Y
Y
Y
Monitor-in cable ( R, Y, W BNC pins to 2.5mm phone jack)
Y
?
?
Y
Rescue disk USB drive
Y
?
n
?
Recovery DVD-ROM set
Y
?
n
Y
Express Media Player Recovery CD
Y
?
n
Y
Windows 2003 software box and disks
Y
n
n
Y
Microsoft Office Professional edition 2003
Y
n
n
Y
3G modem
n
?
Y
?
3G modem USB extension
n
?
Y
?
modem
n
?
Y
?
modem cable
n
?
Y
?
Serial cable D9-D25
n
?
Y
?
Modem RSJ45 modem computer cable
n
?
Y
?
SOFTWARE ITEMS
PERIPHERALS
Geocomputing Management 141 USB mouse
n
n
n
n
USB mouse transmitter
n
n
n
n
earphones
n
n
n
n
Wireless Hub
n
n
n
n
Ethernet RSJ patch cable
n
n
n
n
USB-A to USB-B
n
n
n
n
HDMI to VGA projecter adapter
n
n
Y
n
LEGEND n : this should not be in the package Y : this should be in the package ? : this may or may not be in the package NOTES 1 This for displaying video from digital camcorder or video record on the in-built LCD screen, using the monitor-in port
Comparison and delivery Once you have received quotes you may like to rank them with Microsoft Excel as discussed in the example ‘A comparison of vendor quotes’. Then when you have decided the best one do a final check against your full needs as in Table 34. You can reuse the same table to check off your delivery when it arrives. Additional peripheral devices are shown in Table 34. Also required are all necessary cables and connectors for the above. As from 2007, the main method of interfacing computer to printer is WIFI, minimum of 11g standard. A serial port and interface is required for potentially connecting to field equipment and downloading data or uploading programs. A USB port replication box such as the Targus model PA075 would be a suitable alternative. The pack list for a laptop computer, when either unpacking, travelling or disposing of it into its original packing would include:
The laptop computer The power cord The power transformer The manual An Ethernet connector A phone/modem cable The device drivers excluding those of Table 23
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 142 The system must be assembled, configured and tested before purchase. Any maintenance or support packages are of great interest. If possible I would like a 5-year warranty. Table 34 checklist for the premier quote and delivery item
EQUIPMENT CATEGORY need1
quotation2 incl. sep. m y m y
OK
m y SOFTWARE MODULES Microsoft Office as per Table 26 I X X Virus Checker as per Table 25 I X X SYSTEM HARDWARE central processing unit I X big LCD/Plasma screen II X 3½ floppy disk drive II X 5¼ floppy disk drive III alternate backup drive/card III X modem I X AC Adaptor I X security cable I X necessary cables and connectors I X notebook carry bag I X 8 G USB drive for recovery disk I X peripherals as per Table 129 SERVICE assembled, configured and tested I X configuration is reported separately I X System manual I X drivers on CD-ROM (Table 34) I X 3 year warranty II X 5 year warranty III 1 Key to need is: I, must be present; II, should be present; III, could be present. 2 Key to quotation is: X, specified in quote; ?, should ask the vendor about this; -, not specified but doesn’t matter; Items that are bundled with the computer are given in the ‘incl.’ columns, whereas the ‘sep.’ columns are for additional purchases. m: is my requirements and the example given in this section. y: is your requirement and situation.
Geocomputing Management 143
Identifying the processes used in a computer system for natural history Some of my colleagues and I think that all endeavour involving nature and studying nature will eventually be modelled by similar computer systems. This generalised natural history computer system will be used to contain a whole-of-earth model that will be available to answer all questions regarding geology, biology, astronomy and perhaps even history. It won’t necessarily be the same system, but we suspect the many systems with many collections of data, providing those answers, will eventually have a similar framework. Currently, we think that framework will have several sub-systems: a.
b. c. d. e.
f. g.
There will be LOGIC sub-system that contains a GIS, a species chart, or stratigraphic column to convey understanding of the earth and expedite the organisation of the data. There will be a GEOMETRY sub-system to draw maps and graphs of the data in time and space. There will be a RHETORIC sub-system to generate picture based publications for the general public and debate The GRAMMAR sub-system to make reports for other disciplines such as lawyers, accountants and engineers who feel uncomfortable with maps. There will be an ASTRONOMY sub-system to handle the increasingly extensive databases of time-referenced data from telemetry (include satellites and probes here) and system control and data acquisition (SCADA) devices. This history system can also be expected to handle the project management and planning that is so critical to field work. There will be an ARITHMETIC sub-system to process and apply algorithms to the data. There will be a MUSIC sub-system to handle any data streams from geophysical devices. Like seismograms and groundwater readings the values will have repetitive patterns which need to be identified, averaged and modelled.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 144 Not all of these proposed sub-systems are fallacies; for example, the genealogy software Legacy Family Tree not only recognises a more extensive set of calendar dates it nearly replaces all other software for the astronomy sub-system, with incorporated tools for reports, data verification, catalogues and place name gazettes. The sections in the chapter discuss how the more evident sub-systems have been developed in recent times.
The logic processing sub-system The earliest reference I have found to some program being used to record the bits and pieces that would make up a technical memorandum but not just typed up in a word processor is in Barnes 1989ww where he mentions “XT Pro has a simple but very useful word processing program”. Traditionally in mineral exploration, prospectors develop their ideas of what the ground in the lease is like, through a series of field trips and synthesis of their field data when they return. In the Ballarat case study we can rely on “provided data” to establish our logic of the earth model, the specifics of which are in the sub-section ‘the logic of the Ballarat earth model’. The logic sub-system encapsulates the geological or environmental UNDERSTANDING of the computer system, with other approaches given in the sections:
using a parser for the logic object model hierarchy non-metric spatial information stratigraphic columns block diagrams
using a parser for the logic The CSIRO in 2010xx were working on a “parser” to give a tool to organise this formulation and put geological realism to the large number of computer-generated statistical models used by petroleum
ww
.'
xx
Barnes, 'Exploration computing in a small company environment.
June Hill, 'Facies modelling with GeoSyntax', PESA News no. 107 (2010), p. 67.
Geocomputing Management 145 engineers. The features of a ‘parser’ which they have identified to document their geological thinking include:
Incorporate geological patterns into facies models. Reproduce the complex shapes of channel fill bodies, including the vertical patterns such as nested or migrating [en echelon?] channels. Show the correct spatial relationships between the various sedimentological entities Be computationally feasible Computer readable (vertical sections, 3D layers) and intuitive to the geologist Precise description in a compact format Probabalistic description of each rule and geometry to display the variation inherent in a sedimentary system.
The CSIRO adopted an encoded, probabalistic grammar in their GeoSyntax development after discarding:
Training images Grid-based models
What can we do without a supercomputing budget? Well like Barnes I also preferred XPPro for jotting down my ideas, and in Table 35 his concept has been interpolated to the CSIRO acme, with scripting languages used to record those jottings. Of special note is the Norton Editor which led the charge with smart text editors, but its strength was for programmers by reading binary files and showing their layout. Golden Software and Paradigm are the only two geoscience software companies with their own smart editors, and nothing which is a stand-alone purchase for geoscience. Other features not listed there:
special character codes
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 146
Table 35 script editors for capturing logic SCRIPTING LANGUAGES BAT, MS-DOS and other text files CSS HTML JavaScript, ECMA script SAX Basic, references object libraries of all Golden Software products Visual Basic for Applications (including Microsft Jet SQL) XML XSL(T) PURCHASE BASIS editor
tick
BUNDLED WITH OPERATING SYSTEM B B
B
B
B
B
B
B
Microsoft IE Develoment Tools
0
0
0
0
0
0
0
0
Microsoft Notepad 1
A A
A
A
A
A
A
A
Microsoft Write 1
B B
B
B
4
2
B
B
Golden Software Scripter version 4 1
0
B
B
0
0
0
A
A
Legacy Family Tree version 8
1
3
3
3
0
4
3
1
Microsoft Script Editor
2
0
0
0
0
0
0
0
Norton Editor
0
0
0
0
0
0
0
0
Paradigm mui_text
2
0
0
0
0
0
0
0
XP Pro
BUNDLED WITH OTHER SOFTWARE
Legend to capabilities 4 automatically indents and saves structure of file as typed 3 provides keywords and attributes 2 highlights keywords 1 word processing capability: upper casing function etc 0 straight text editor A reformats file on save B mistakenly recognizes the key words and changes them NOTES 1 These packages use the internal Microsoft Windows routine IsTextUnicode().or something similar, which casues them to recognise Legacy Family Tree extracts as ANSI files, see the discussion on Wikipedia at: https://en.wikipedia.org/wiki/Microsoft_Notepad
special character codes
Geocomputing Management 147 The use of text files across the Internet has required increasing sophistication of encoding from the original 127-character American Standard Code of Interface and Interchange (ASCII) to Unicode (UTF-8 being the generic level in 2016). In between is the DOS extended character set and the Windows code pages based on the prototype American National Standards Institute (ANSI) which became ISO-8859, as described in the section “ISO Character Sets” of Conway et.al. 2001yy.
UTF-8 ₣₤€
DOS to ISO-8859-1
ٸٻٽٽ
╣║╦
ẢảẤấ
ΣπΦ
ASCII ,.$£¥©
0-9A-Za-z
Figure 18 evolution of character coding from ASCII to UTF-8 The Legacy Family Tree Notes editor can embed HTML codes in any report or web-page produced. These HTML codes are conveyed by using surrounding the HTML elements with the special characters « (HTML code «); and » (HTML code ¸). When viewed in Microsoft Notepad these special characters can cause the default behaviour to misinterpret them (as warned in Note 1 of Table 35). Similarly, files used between Linux and Microsoft Windows have different special character line endings, and extra characters or lines can be observed when browsing a text file. Windows 10 has the two modes of the CMD command: UTF and ANSI to control the encoding of created text files.
yy
{Conway, 2001 #214}
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 148
cmd.exe /U /c cmd.exe /A /c
Discrimination of UTF-8 and ANSI encoding can be accomplished by using the MS-DOS TYPE command in UTF-8 mode as shown with the Command Prompt window in Equation 4. Equation 4 use MS-DOS TYPE command to label text files as UTF-8 help cmd SET DEPOCENTRE=%HOMEDRIVE%\TEMP\robozeme IF EXIST %DEPOCENTRE%\fragment.txt ( cmd.exe /U /c TYPE %DEPOCENTRE%\fragment.txt %DEPOCENTRE%\fragutf.txt )
>
object model herarchy The Golden Software company (also Schlumberger for the Petrel product) have followed the route of an object based approach with each product having a peculiar object, with similarities in printing and manipulation of the attributes of the objects in a hierarchy. I use both Golden Software Surfer (grids) and MapViewer (layers) . I would use Strater (traces) too but I don't have any well/drillhole information at this stage. Also I could also use Golden Software Grapher but I wrote my own ternary diagram software in Microsoft Excel but if I require a special graph it will be first place I look, see the algebraic module for further explanation. I don’t use them separately but as part the rational approach to computing described in this Grimoire. I see Surfer as a processor in stratigraphic-time space (i.e the geology block diagrams) and MapViewer for working in cartographic or real space. If you are looking for a cheap mapping package that can input GIS files and do contouring, gridding and image rectification, I recommend, at least for the entry level, and use Golden Software Surfer. At approx. AUD 800 (see www.goldensoftware.com), it will help further define your requirements and give you mock-ups of your basic data flows. It loads a lot more formats than more expensive packages, comes with some basic GIS files to start your cartographic database, and has every contouring and general kriging algorithm I
Geocomputing Management 149 can think of. It runs on Microsoft Windows, so doesn't require a Unix system, and has a macro language similar to Visual Basic to enable your first batch processing. In effect I use the Golden Software modules to develop prototypes suitable for research into geological problems. So far a statratigraphic column. a simple petroleum model for the Cooper Basin, a kriging of distance between major ports to demonstrate numerically why Australia is isolated, an urban sprawl monitor for the western side of Melbourne, heritage site management of the Broadview Freemasons Centre, and integration of various archaeological web-sites. I publish my stuff mainly to the Microsoft IIS intranet or ftp to a website from an internet service provider (that is only application-side scripting, no server-side scripts).
non-metric spatial information I used MapViewer for making up research asset inventories (described in the Grimoire) but I am definitely enamoured with KML in Google Earth now, as this allows use of relative or topological placement (recently an article in Position Magazine zz described this as non-metric spatial information) and is an analogue to the airphotos I would mark-up in the field with wax pencils. MapViewer is now tending to be my cartographic tool in contrast to research asset inventories and I have a presentation on why I think Google Earth is superior for this should you be passing through Adelaide. The fly-through of the Greece 2001 expedition aaa gives you a start but still MapViewer is supreme for location maps (the capability page on my web-sitebbb), and formal cartography (such as site plansccc).
Winter, 'What is the Value of Spatial Information?', no. The fly-through to the 2001 Greece expedition was last found at: http://www.grantjacquier.info/greece.kml bbb The capability statement page for Computers in geology was last located at: http://www.grantjacquier.info/home_files/cingfld.htm ccc site plans made with MapViewer are shown at http://www.grantjacquier.info/bfmc_files/bfc.htm zz
aaa
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 150
stratigraphic columns I also use MapViewer as a general computer-aided drafting (CAD) package not only for plans but stratigraphic columns, which also summarise the geological understanding. The geological benefit is that: 1. MapViewer treats cartographic space, and Surfer a theoretical space (geological block diagrams), 2. and both with algorithmic rigour, so I can trust that whatever I have to do, the algorithm will be there somewhere; 3. and the supplied data is consistent and clean and shared 4. The loading mechanisms are straight forward with a preference to ASCII, Microsoft Excel and with Surfer version 9, Microsft Access. 5. An ethical commitment to education, whereas I feel ESRI is trying to lock schools into their software (there is more on that in the section ‘Understanding the weaknesses of the American marketing style’). 6. The confidence that I can program any repetitive work as a macro, very important in development geology where a time series or different commercial factors are involved Surfer was my first choice of the suite because I loved the way the kriging has been done. I used MapViewer as a replacement for ESRI ArcView that I used at the University of Melbourne because it is in my price range, I liked the Surfer interface and so wanted to continue with the brand, and I enjoyed how they provided data files on the CD-ROM which saved me writing away for polygons. The commercial benefits for me are:
the strongest integration with Windows that I have experienced outside the Microsoft Office suite. Downtime is a problem for me as I charge by the hour, that is my only income. So from this outline descends a good installation routine, good updates (a Google disadvantage), and general good quality workmanship with the programming. the low commercial price, I am not continuously asking whether I have to upgrade the version to meet licensing requirements (The Google Map problem),
Geocomputing Management 151
consistent interface reducing my training times, geology is about integration of widely diverse facts into a widely imaginative story, the last thing I need is a technical college learning curve to throw out one figure. I reduce down the margins of Europe, say just down to Greece looks good on the MapViewer, then I export it as web-page. A massive amount of white space results, as the boundaries of the HTML extract are set on the data set, not the plotted area, therefore I have to cut the polygons first and make sub-set of the polygons. (I haven't checked if this is still the case in version 7) The export of Atlas boundary files in BLN format is compatible with Vector Markup Language, if I remove any decimal places manual (change the cale option to give integers rather than real numbers). It would be nice to have an integer export button there for more complex shapes, save me doing the editing manually. But I am thankful for the PDF output in the latest MapViewer, I had to redo those seating plans for the Freemasons Centre (to allow caterers to write down the guests names).
geology block diagram To use Surfer for a geology block diagram you do have to do a lot of work for example to produce the diagram with dip directions indicated by bedding traces: These steps are also a template for producing a geological map, from your own measurements, over your area of interest. 1. Create a 3D surface for each unit, and generate the Golden Surfer block (surveyor/engineer) model 2. Create a structure layer and contour the dip and strike measurements to give bedding traces for each unit, then blank this layer just for the outcrop 3. Repeat step 2 for the two sides of the block model and output as JPEG files 4. Overly the surface bedding traces on the top layer of the block model. 5. Add your cultural annotation such as map symbols for land use and output the annotated block model as a JPEG file C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 152 6. Combine the three JPEGs using the Vector Markup Language (VML)
elementddd to give you a very basic geological block diagram in an HTML page. I am looking forward to the Microsoft SilverLight improvement on VML because perhaps each side and top of the block can be treated as a flat orthogonal surface. In some of the examples of Silverlight I have seen on the web, there appears to be an angle of orientation adjustment of the pixels, whereas with VML you have to arrange the layers into a mosaic with the block top-layer overlapping the two side layers. If you have image editing software, it may be easier to match the three surfaces there. Finally, if you really want to get serious about geological block models, Ligno3D Designer (www.ligno3d.com), written by Dr Rod Ryburn, (formerly of the Australian Geological Survey Organisation), can present your block surface, or even more complex shapes, and then print out construction plans for a carpenter to assemble it. In version 3.53 there is a template for a split frame geodesic dome which you could use to make a portable cavern display for school children. Currently the display view is limited to using bitmap files on the faces which add a further level of processing, but see the ‘Veneer Texture command (Decor Menu)’ in the on-line help file (http://www.ligno3d.com/HTMLhelp/index.html) for the example of a photo cube. There is auto-option which generates the solid texture from a face bitmap, which may give a quick 3D model from some geological maps
the logic of the Ballarat earth model In the example of the Ballarat sheet Earth Model the logic is contained in the interpreted layers of the 1: 100 000 Geology of Victoria layers. The GSV Geology 100 is from a formal geological map with many elements but for this exercise we only use the formations and the faults interpreted for the Ballarat region:
.\mapinfo_export\geol100\ball_geology .\mapinfo_export\geol100\ball_structure
'World Wide Web Consortium', 'Vector Markup Language (VML),' in Advanced Properties of Shapes NOTE-VML-19980513 (World Wide Web Consortium, 1998). ddd
Geocomputing Management 153 These can then be presented in the software ESRI ArcView (or Golden Software MapViewer. Usually the loading and then verification of the data is in two stages. Initially the data must be exported from the source database into an intermediate file format and then in the second stage the export file is loaded and verified in the software you are using. In this particular example, the exporting of the data has already been done by the GSV and the intermediate files are on the CD. You need to convert from a proprietary application format to one, which can either be loaded or converted to another application format. In a good data set such as the Ballarat GIS Data this will be done for you! The MapInfo export (MIF/MID) files can be found on CD-ROM 2 at:
g:\ballarat_GIS\ballarat_GIS2\gis\mapinfo_export
In this case the export files in MIF/MID format need to be first converted to a format SHP/DBF that can be read by the software. Check type of data by running the conversion program with the information parameter INFO as in Figure 19. Start | Programs | Applications | Command prompt cd g:\ballarat_GIS\ballarat_GIS2\gis\mapinfo_export\geol100 c:\ESRI\AV_GIS30\ARCVIEW\BIN32\MIFSHAPE INFO ball_geology
Figure 19 checking MapInfo export files The computer hard drives can be setup by: My Computer | Tools | Mount network drive. The result of the procedure gives you the type of GIS vector element i.e. either:
polygon (POLY) line (LINE) point (POINT)
Create a working folder with ONLY the data you are interested in: mkdir c:\convert copy .\mapinfo_export\bores c:\convert\.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 154 Run the conversion program for the theme (POINT, LINE, POLY) of interest. Start | Programs | Applications | Command prompt cd c:\convert c:\ESRI\AV_GIS30\ARCVIEW\BIN32\MIFSHAPE POLY bores mybores
Load the Shape files (SHP) into ESRI ArcView then present and overlay files from the same set.
The geometry processing sub-system The geometry sub-system usually involves software in the category of Computer Aided Drafting (CAD), but traditionally included shared cartographic data files for example Figure 20. Because maps and much CAD work is a two-dimensional expression of a three dimensional observations the geometry module usually has some facility for managing this projection of 3-dimensional data onto a 2dimensional plane. ../World ../World ../World ../World ../World ../World ../World ../World ../World ../World ../World
Miscellany/Africa Miscellany/Antarcal Miscellany/Antarcll Miscellany/Asia Miscellany/Camerica Miscellany/Namerica Miscellany/Russia Miscellany/Russia-proj Miscellany/Samerica Miscellany/World Miscellany/Worldcap
Figure 20 some of the mapping files provided with Golden Surfer MapViewer Paul Maconochie explained that he bought a Surpac license and found it immensely useful, although expensive as he does not use it for all work. One programme that he noticed that I don’t treat here and Paul is constantly using is “Canvas”. He was introduced to Canvas by the mining engineer Kevin Rosengren and then abandoned CorelDraw which he had used for over 20 years since version 2. Paul’s strengths of Canvas are:
A technical drawing package that handles both bitmaps and vectors and has a GIS add-on.
Geocomputing Management 155
It has to be good at georeferenced and scaled maps, sections and drawings. It has to a whole heap easier to use than a CAD package. One of the things Paul does use it for, is to trace over scaled bitmaps, he can then select the table showing the coordinates of the line has just traced and copy and paste that into his slope stability software.
I find Paul’s procedure is very similar to what I have used the Golden Software products in the demonstration ‘A training or emergency plan’ in Chapter 3. However, in this section I deal further with the issues of: 1. The use of maps for business requires recognition of public mapping standards. 2. Recommended cartographic projections, data sets and scales in Table 36. This pick list matches the MapViewer files against case studies. 3. Other projections in general use 4. Some notes on the cartographic module for the Ballarat earth model
i
White, Management of mineral exploration.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Table 36 pick list of parameters for making a GIS layer document: .gsm
files in use of types in Table 92 batch file: suprm.bat
replaces: .gsm
date poster.bat
general specification
pick large size bureau printed poster, A0 plan size map
Medium size bureau printed poster, A2 plan size map Two page report spread, A3 plan size map Single page for report, A4 plan size map Report figure A6 plan size map Pinboard compatible D5 plan size map Map projection journal number 1
5
4
5
3
6
2
1
7
8
Landscape (L) or portrait (P) orientation
L
L
L
L
L
P
L
L
L
Case study given in Table 37
I
II
I
III,VI
VII
IV
V
VIII
IX
SUPPLEMENTARY DATA data file Other
GS MapViewer ../World Administrative/Australia
-
-
-
c
X
-
-
../World Miscellany/EUROPE
-
X
-
-
-
X
X
-
WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 157
document: .gsm
files in use of types in Table 92 batch file: suprm.bat
replaces: .gsm
date poster.bat
../World Miscellany/Oceania
-
-
-
c
c
-
c
../World Miscellany/Pacificn
-
-
-
X
c
-
-
../World Miscellany/Pacificp
-
-
-
X
c
-
-
../World Miscellany/WORLD
-
c
-
c
c
c
c
../World Miscellany/World-proj
-
-
-
-
-
-
-
LAYER DESCRIPTION Options > Units Page units coordinate display units centimeters centimetres
Map > Scale Scale method X\Y scale 1.0 cm = ??? (scale) 2 Map Units (1:200) 5 Map Units (1:500)
Surface distance Units meters feet
X
-
X
Options > Rulers and Grid Ruler divisions per cm 5
Surface area units square meters square feet
other
THEME ELEMENTS (using GS Property Inspector or from the Appendix, styles.BAS in Equation 99) Line, Polygon, Background Text Color Width Face size Microsoft font faces Font faces from other vendors Black 0.2 cm 40 Arial Golden Software GSI Map Symbols Grass Green
16
Arial MT Rounded Bold
Golden Software GSI North Arrows
Red
14
Symbol
HazChem
12 8
Webdings other:
other:
End Style Simple head
Arrow Scale 2
NOTES C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 158
document: .gsm 1
X c
replaces: .gsm
files in use of types in Table 92 batch file: suprm.bat
date poster.bat
The projection journal number refers to the table ‘projections’ found at www.grantjacquier.info/develop.htm LEGEND This set of digital boundaries has no use with this case study This set of digital boundaries can be used for adding texture to the map This set of digital boundaries can be used to cut the boundaries and for general divisions
public mapping standards In converting geographic coordinates for plotting on paper, the correct cartographic projection has to be set. Some examples of these are shown in Table 37. Where this projection is a standard projection in use by others or government there are additional conventions required to build a standard. Initially, the sphere was used to represent the mathematical shape of the earth. Later the sphere equation was distorted by algorithmic manipulation to better match the surface of the earth to produce what is known as a spheroid. mapping grid e.g. AMG, MGA
geodetic datum e.g. GDA94, AGD84, ITRF92, WGS84
spheroid eg: ANS, GRS80, Clarke 1866 sets of reference coordinates eg: AFN, ANN, IGS(ITRF), projection e.g.: UTM, TM, Albers Equal Area
height datum e.g.: AHD
Figure 21 hierarchy of public mapping projection standards The projection Clarke’s of 1866, was the basis of the Australian and New Zealand projection systems. If an origin for counting out coordinates is decided for that spheroid that then provides a geodetic datum. In practice, this origin is defined by reference coordinates or datum and so the basis for the term geodetic datum. As an example, the coordinates used in AGD66 were recalculated using more sophisticated equipment to produce the datum for AGD84 but both were based on the same Australian National WWW.GRANTJACQUIER.INFO/GRIMOIRE.PDF
Geocomputing Management 160 Spheroid (ANS). The geodetic datum can then be applied to a projection to produce a flat map or screen display and then all that is required to complete the mapping grid system is a height datum to standardize the elevations shown on the map. This hierarchy is shown diagrammatically in Figure 21. Various combinations of spheroids and control coordinates give the different mapping systems shown in Table 49. In the check list of Table 37 are some of the data files supplied with MapViewer and Microsoft Windows for this work, and Table 36 gives case studies of matching these files with appropriate projections.
Geocomputing Management 161 Table 37 example plans by terrain class SCOPE (suggested projection) see 7.9 Stages of engineering construction in relation to the terrain classes, page 291 of Berkman 1989 title (case identifier) scale projection 0 TERRAIN CLASS = “NaN”, GEOGRAPHICAL CONTEXT (Times3 and as given) Pacific Ocean (VI) 1:50 million Lambert Azimuthal Equal-Area The Pacific Ocean (III) 1:48 million Lambert Azimuthal Equal-Area … World Sedimentary Basins (IX) 1:23 million VanDerGrinten Australia (VII) 1:20 million Bonne Australia: S.W. Pacific (VII) 1:15 million Bonne S. YUGOSLAVIA: GREECE: … (V) 1:3 million Equidistant conic projection 1 TERRAIN CLASS = “Province”, GEOLOGICAL DISTRIBUTION (as given) South Australia Lambert Conformal Conic 4 Victoria VICGRID 5 The Balkan States (IV) 1”:100 mile Equidistant conic projection 2 TERRAIN CLASS = “Terrain pattern”, GENERAL QUANTITIES (as given) Victoria VICMAP 5 Greece (I) 1:10 million Lambert Azimuthal Equal-Area 3 TERRAIN CLASS = “Terrain unit”, GENERAL DIMENSIONS (as given) 4
I II III IV V VI VII VIII IX
TERRAIN CLASS = “Terrain component”, VARIOUS PLANS (mine grid, orthogonal) Broadview Freemasons Centre (I) 1:72 orthogonal CASE STUDIES (from Table 36 ) emergency plan for Broadview Freemasons Centre, 1:72 scale, orthogonal projection with an unscaled evacuation plaque. 1:10 million scale Greece context map using Lambert Azimuthal Equal-Area projection 1:48 million scale Lambert Azimuthal Equal-Area projection for “The Pacific Ocean” on p. 134 of The Times Concise Atlasa 1”:100 mile scale Equidistant conic projection for “The Balkan States” on p. 45 of Newnesb 1:3 million scale Equidistant conic projection for “S. YUGOSLAVIA: GREECE: BULGARIA: W. TURKEY” on pp 46-47 of The Times Concise AtlasError! Bookmark not defined. 1:50 million scale Lambert Azimuthal Equal-Area projection for “Pacific Ocean” on p. 86-87 of Newnes Error! Bookmark not defined. Bonne projection (scale 1:20 million, central meridian 138E, standard parallel 25S?) is used for “Australia” on page 88 of NewnesError! Bookmark not defined. The Bonne projection, scale 1:15 million, is used for “Australia: S.W. Pacific” on page 137 of The Times Concise AtlasError! Bookmark not defined. The VanDerGrinten projection (central meridian 0, width 360, scale 1:23 million) is used for Petroconsultant’s World Sedimentary Basins and also for National Geographic.
NOTES 3 Also used for Encom Permits of Australia 4 South Australia Atlas, as per Table 39 a b
"The Times" atlas of the world, (London, 1994). Newnes International World Atlas, (London, 1967).
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 162 5 VICMAP
used in Victoria before 1998, VICGRID since 1998, see page 174 or Table 39.
recommended projections Projection problems such as in Figure 22 require the field geologist to have close supervision of the spatial framework for the earth model.
Figure 22 boundary displacement after reprojecting In general the projections in Table 38 should be used in the following way: Base data like transits, and borehole trajectory should be plotted on flat orthogonal planes for small areas less than 1 kilometre diameter, but beyond this you should use a universal transverse Mercator (UTM) projection. With ore reserves it is important maintain the area correctly. In UTM projection based maps regions of the same area will appear differently depending on where they are placed with respect to the central meridian. Where the ore reserves, or even a hydrological model, are being modelled as a finite difference grid then an orthogonal flat projection would be easiest especially if this is already available with the local mine grid. For resource estimation on a regional scale there are projections, which give equal areas, and one such, Albers Equal Area Conic, is used routinely for the Geology of Victoria. Just as when doing it by hand, aerial photographs and satellite images need to be joined on a flat surface on the computer. The UTM projection has a slight curvature and so is not always suitable for producing a mosaic. A
Geocomputing Management 163 simple transverse Mercator projection doesn’t have that curvature and can be used. Table 38 general guide for use of map projections base data YES YES YES
ore reserve
well projection type 5 sites YES equidistant conic 1 YES universal transverse Mercator 4 YES YES orthogonal flat plane 3 YES YES Albers Equal Area Conic 6 YES YES Bonne 1 2 YES YES Lambert Conformal Conic YES YES transverse Mercator YES Van der Grinten 1 YES WGS84 geographic 1 for examples of projections used in maps of mineral provinces see Table 37 2 The Lambert Conformal projections in Table 39 are particularly useful for provinces extending across multiple UTM zones. 3 Useful for regions of a kilometre or so across, as by 10 km the curvature of the surface of the earth has an impact. 4 The universal transverse Mercator projections in Table 41 and Table 42 are better solutions for regions of tens of kilometres or so across, as the projection has been adjusted for the curvature of the surface of the earth. 5 For the specific uses in a single jurisdiction, see the example of Victoria in Table 49. 6 a Victorian example of an Albers Equal Area projection is given in Table 47. province 1
image montage
Special maps for whole provinces, such as a state or country often require special projections to show all the necessary detail. Examples used by geologists are given in the introduction in Table 37. The Lambert Conformal Conic projection is of particular use for provinces, which stretch across several Universal Transverse Mercator zones. This is the case with the Australian states of South Australia and Victoria; and the official specifications for these projections, the South Australia Atlas and VICGRID (previously VICMAP) are shown in Table 39. Table 39 Lambert Conformal Conic projections parameter 1st parallel 2nd parallel central meridian latitude of origin false easting
South Australia Atlas -28 -36 135E -32 1 000 000
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
VICMAP / VICGRID -36 -38 145E -37?
Geocomputing Management 164 false northing scale
2 000 000 1 : 2 million 1 : 4 million
I like using Google Earth and the coordinates presented there are in WGS84, which is the default one used for the Global Positioning System or GPS. The World Geodetic System (WGS84) is the spheroid and reference coordinates used for the native GPS calculations. The spheroid used is centred on the earth’s core and re-aligned regularly, making it ideal for global navigation. Where the coordinate system is re-aligned regularly against control points it is called a dynamic datum, for GPS it is the ITRF as shown in Table 40. As it is great for navigation, most marine seismic geophysics is collected against WGS84 coordinates, which will need to be reprocessed into the local mapping grid. Similarly, handheld GPS receivers will need to have conversion algorithms loaded or selected from pre-existing functions using fixed datum transformation functions, to convert these coordinates to the local mapping grid. For quality control and first inspection of the data, especially browsing with Google Earth, it may be better to just use the WGS84 coordinates as they are. For more detailed work Stanaway (2009)c feels that the fixed parameter methods such as NGA will be inappropriate as WGS84 and GDA94 diverge with time. For tectonically active areas like Indonesia, Papua New Guinea and New Zealand he suggests you accept the concept of a dynamic datum, and expand your database to includes the time of the measurement. This time indicator is called the epoch and will look something like ‘1994.0 ITRF1992’, which is the epoch of the GDA94, the Geocentric Datum of Australia used for MGA. He prefers other correction techniques in continental Australia, where the stiffer tectonic plate doesn’t distort relative distance to the same extent as for New Zealand. For this situation he gives the examples of Auspos GPS service by Geoscience Australia, or plate tectonic movement models such as the Actual Plate Kinematic Model or NNR-Nuvel-1A. Finally, the rest of this chapter is special sub-sections with more information on the subjects below. Each section tries to give a history and technical description as well as illustrating advantages to using the particular projection system. universal transverse Mercator (UTM) c
Richard Stanaway, 'When the Earth moves?', Position Magazine no. 39 (2009), pp. 41-42.
Geocomputing Management 165 Mapping Grid of Australia (MGA) Australian Map Grid (AMG) Albers Equal Area Conic VICMAP VICMAP-TM VICGRID
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 166 Table 40 geodetic monitoring networks after Featherstone CODE, network of reference coordinates counts (space, time) date scope tied to ITRF, IERS Terrestrial Reference Frame 1 origin 1992 Earth ?, > 3 WGS, World Geodetic System4, 5 origin 1984 Earth ?, 1 xxxx.x ITRF1992 CTRF, Chinese Terrestrial Reference Framework origin < 2010 China 28, 1 xxxx.x ITRF1992 CORS origin < 2010 China 2500,1 CTRF IGS, International GPS Service for geodynamics origin 1992 Earth ?,1 1994.0 ITRF1992 AFN, Australian Fiducial Network origin 1992 Austl. 8,1 IGS1 ANN, Australian National Network origin 1994 Austl. >8,1 AFN Auspos GPS service by Geoscience Australia (GA) origin <2010 Austl. >8,>1 ANN SunPos origin <2010 Q/WA ??? ANN?? CORSNet (also starting the AusCORS with GA & L.P.M.A.8) origin <2009 N.S.W 28,>1 ANN VicMap Position by Department of Sustainability and Environment origin <2010 Vic. + ??? ANN?? GDA94, Geocentric Datum of Australia origin 1994 Austl >8,1 AFN NZGD2000 New Zealand geodetic datum 2000 6 origin 2000 NZ ?,>1 IGS1 5 Australian differential GPS services origin 2000 Earth ?, >1 ITRF2000 origin 2005 Earth ?, >1 ITRF2005 Johnson Geodetic Station, near Alice Springs, Northern Territory origin 1966 Austl. 1,1 1st order3 ATN, Australian. Trigonometric Network origin 1966 Austl. >1,2 Johnson AGD66, Australian Geodetic Datum 1996 origin 1966 Austl. >1,1 ATN AGD84, Australian Geodetic Datum 1984 origin 1984 Austl. >1,1 ATN NA, North America origin 1927 N.A ?,1 ?
2
Geocomputing Management 167 CODE, network of reference coordinates date
scope
counts (space, time) tied to
NAD27 origin 1927 N.A. ?,1 NA NAD83 origin 1983 N.A. ?,1 NA Greenwich Observatory origin ? G.B. 1, 1 1st order3 OSGB, Ordnance Survey Great Britain origin 1936 G.B. ?, 1 Greenwich OSGB36, Ordnance Survey of Great Britain 1936 origin 1936 G.B. >1,1 OSGB OS(SN)80, Ordnance Survey of Great Britain 1980 origin 1980 G.B. >1,1 OSGB LEGEND FOR SCOPE Austl. : the Australian continent, islands and the island of Papua New Guinea. . AU : Australia the nation (including Antartarctic territories and seabed claims) Earth : surface of the Earth G.B. : Great Britain N.A. : North America . N.S.W. : New South Wales Q/WA : The Australian states of Queensland and Western Australia Vic + Gibbs (2010)d explains that this extends across the state of Victoria to the Barossa Valley in South Australia. NOTES 1 An epoch (epoch 1994.0 ITRF1992) is required for ITRF1992 because we think continental drift changes the coordinates with time. 2 data from Featherstonee 3 1st order: Primary astronomical observation. 4 Stanaway and Dawsonf point out that WGS, unlike GDA94, takes the latest calculation (e.g. epoch 2000.0 ITRF1992) of ITRF. 5 Stanaway (2009)g clarifies the divergence of GDA94 and differential GPS systems commonly used in Australia. 6 Pearse 2003h introduces the New Zealand dynamic datum 7 Position Magazinei gives the reference framework to be used with the Republic of China’s Compass GNSS (global navigation satellite system) 8 Janssen, 2010j explains how the first AusCORS site was constructed.
William Gibbs, 'The Networks are coming', Position Magazine no. 44 (2010), pp. 71-72. William Featherstone, 'An updated explanation of the Geocentric Datum of Australia (GDA) and its effects upon future mapping', The Australian Surveyor (1996). f Richard Stanaway and John Dawson, 'The Divorce of Two Datums', Position no. 20 (2005), p. 78. g Stanaway, 'When the Earth moves?', no. h Merrin Pearse, 'The Third Dimension', Position no. 6 (2003), pp. 75-77. i 'Towards Multi-GNSS', Position Magazine no. 45 (2010), p. 16. j Volker Janssen, 'Precision Rules!', Position Magazine no. 44 (2010), pp. 77-78. d e
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 168
universal transverse Mercator The universal transverse Mercator (UTM) projection is a system of sixty zones spread over the whole earth. The zones numbers for the western hemisphere are 1 to 30 as in Table 41 and those for the eastern hemisphere 31 to 60 (Table 42). Each zone is six degrees of longitude wide and is specified by a central meridian and a standard factor of curvature of the surface away from that meridian. Table 41 central meridian2 for western hemisphere UTM zones1 1 2 3 4 5 6 7 8 9 10
177W 171W 165W 159W 153W 147W 141W 135W 129W 123W
11 12 13 14 15 16 17 18 19 20
117W 111W 105W 099W 093W 087W 081W 075W 069W 063W
21 22 23 24 25 26 27 28 29 30
057W 051W 045W 039W 033W 027W 021W 015W 009W 003W
Table 42 central meridian2 for eastern hemisphere UTM zones1. 31 003E 42 069E 53 135E 32 009E 43 075E 54 141E 33 015E 44 081E 55 147E 34 021E 45 087E 56 153E 35 027E 46 093E 57 159E 36 033E 47 099E 58 165E 37 039E 48 105E 59 171E 38 045E 49 111E 60 177E 39 051E 50 117E 40 057E 51 123E 41 063E 52 129E 1 Zones are 6 degrees of longitude wide, which limits the amount of distortion on the edges of the zones. 2 From pages 146-147 of Berkman, 1989a
Mapping Grid of Australia The Mapping Grid of Australia (MGA) is the combination of the Geocentric Datum of Australia (GDA94), Australian Height Datum (AHD) and UTM projections for zones 49 to at least 56 (see Table 42); whereas the Australian Map Grid (AMG) is based on the a
Berkman, Field geologist's manual.
Geocomputing Management 169 universal transverse Mercator projection but with the Australian National Spheroid (ANS) it was known as the Australian Geodetic Datum 1984 (AGD84) or AGD66 depending on the state as in Table 43. As with its replacement MGA it was used for UTM zones 49 to 56. MGA was in use from 1996 onwards. The recommendations in Table 43, give first pass corrections to coordinate data sets existing before this time, with this effect also applying to the corresponding latitude and longitude. Table 43 estimates of offset from the MGA (Mapping Grid of Australia) coordinates for the old AMG (Australian Mapping Grid) and other datum other geodetic datum 3 instance Easting Northing AGD66, Australian Geodetic Datum 1966; AMG for ACT, NSW, NT, TAS, VIC New South Wales 1 + 113 m + 184 m AGD84, Australian Geodetic Datum 1984; AMG for QLD, SA, WA South Australia 2 + 125 m + 175 WGS84. World Geodetic System 1994 ITRF1994 2009 ITRF1994 NOTES 1
precision
± 15 m ± 0.01 m ±1m
from Zahra 1995b, 2 Sandford 2001c, 3 Featherstone 1996d and Stanaway 2009e
This effect is less significant at greater scale maps, and can be ignored in scales greater than 1: 500 000. This practical cut-off can be recognised from Figure 23, a plot of point displacement between AMG and MGA plots of the same co-ordinate values in a region in central New South Wales, and for comparison a range of similar corrections for bringing WGS84 points to GDA94. It also demonstrates that including GDA94 and AMG data in a single plot is a problem of greater magnitude than just using the coordinates of a GPS directly without adjustment. Charles Zahra, 'Background report on GDA - impact on paper maps,' (Paihia, New Zealand: Intergovernmental Committee Surveying and Mapping, 1995). b
c
Geoffrey R. Sandford, 'The new mapping datum for Australia, Geocentric Datum of Australia 1994 (GDA94), notes for recreational users when using maps.,' (Adelaide: Department of Environment and Heritage, 2001). d Featherstone, 'An updated explanation of the Geocentric Datum of Australia (GDA) and its effects upon future mapping'. e Stanaway, 'When the Earth moves?', no. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 170
displacement (mm on log scale)
100000 10000 1000 100 10 1 0.1 1
100
10000
1000000
0.01 map scale ( 1: x on log scale) - AMG data from Zahra 1995f, WGS data from Stanaway 2009g(in purple’ epoch 2009; and blue, epoch 1994)
Figure 23 point displacement between AMG, WGS84 and MGA plots. However, the UTM projection based mapping grids are good for maps of around 1:100 000. For larger regions the states and territories have adopted other projections which are summarised in Table 44. Also in Table 44 are the appropriate height datum and geodetic datum to be used with each grid. The height datum would be important for groundwater monitoring but the geodetic networks, which are getting more precise each year as new measurement technology is implemented, will in the future, be important in measuring deformation of the Earth’s crust. Table 44 official mapping grids used by Australian governments, sorted by projection used. projection geodetic datum (see Table 45 ) height datum (see Table 53) Height datum epoch is assumed from adoption date.
f g
Zahra, 'Background report on GDA - impact on paper maps.' Stanaway, 'When the Earth moves?', no.
Geocomputing Management 171 OFFICIAL MAPPING GRID UTM – Universal Transverse Mercator AMG66 AMG84 MGA Lambert Conformal Conic South Australia Atlas VICGRID VICMAP
AHD66 AHD71 AHD71
AGD66 AGD84 GDA94
AHD71 AHD71 AHD66
GDA94 GDA94 AGD66
The specifications of the different geodetic data are summarized in Table 45. The table is ordered by year of commission to make it easy to choose the more precise geodetic datum if there is more than one available, thus giving you a more sensitive baseline for tectonic studies. Table 45 increasing precision of geodetic data GEODETIC DATUM spheroid (see Table 48) NZGD20002 GRS80 GDA941 GRS80 WGS841 WGS spheroid ITRF921 GRS80 WGS841 WGS spheroid AGD841 ANS NAD831 WGS spheroid? OS(SN)801 Airy 1830 AGD661 ANS OSGB361 Airy 1830 NAD271 1 after Featherstone h, 2 after Pearsei
AFN WGS ITRF WGS ATN NA OSGB ATN OSGB
reference coordinate network (see Table 40) measuring technology GPS GPS GPS + adjustments Laser / Interferometry / GPS GPS (+/- 200 ppb) Tellurometer, land and satellite GPS Tellurometer, land and satellite? Tellurometer, (+/- 2 ppm) theodolite? theodolite?
The geodetic data in Table 45 are maintained by monitoring the distance of control points in the networks in Table 40 and to the GPS satellites. Where coordinates have been taken directly from a GPS receiver the height measurement is not the elevation as you would expect from the local height datum such as Australian Height Datum Featherstone, 'An updated explanation of the Geocentric Datum of Australia (GDA) and its effects upon future mapping'. i Pearse, 'The Third Dimension', no. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM h
Geocomputing Management 172 (AHD). Rather it is a theoretical elevation derived from the spheroid used for the WGS80 coordinates. This is because the satellites spinning around the Earth, measure their position with respect to the centre of gravity, not the designated local political standard usually derived from mean sea levels at the nearest port. These heights can be adjusted to match local mean sea level measurements by using a model of the local surface assuming input coordinates from a geocentric spheroid such as WGS80. Any examples I have come across are in Table 46. Table 46 geoid models geoid model EGM961 AusGeoid981 1
scope Earth Australia
date 1996 1998
accuracy +- 1 m
from Pearse 2003j
Albers Equal Area Conic The ‘Regional Geology of Victoria, 1:500 000 series’ and the associated data set code-named GEOL250 are presented in an Albers Equal Area Conic projection. This has the advantage of presenting all regions as the correct area though not necessarily the correct shape. This makes the projection Ideal for regional ore reserve calculations, dry land salinity or agricultural yield forecasts. The technical specification for presenting the GEOL250 data is given in Table 47. Table 47 Albers Equal Area Conic projection for VICMAP parameter False origin easting False origin northing standard parallel 1 standard parallel 2 Lambda 0 spheroid
VICMAP-GEOL250 4 500 000 m W 2 500 000 m S 36 S 38 S 145 E ANS, 1996
VICMAP-TM (Transverse Mercator)
j
Ibid.
Geocomputing Management 173 For use with satellite images, Land Victoria developed an absolutely flat Transverse Mercator projection, VICMAP-TM based on the ANS spheroid. This allows all satellite images over Victoria to be spliced together, without wrinkles, to give a continuous satellite image. The use of the Transverse Mercator suggests to me that where the region of interest is less than the width of the scan of a satellite, such as mine, an archaeological dig, a farm, an environmental cleanup site, it would be easier to match the additional mapping data to the plane of the image rather than rubber sheeting the image to a nominal standard map projection. Especially if a three dimensional model is required anyhow, it can be built assuming the plane of the image is flat. This makes monitoring where several images may be used much easier to automate as individual rubber sheeting is not required. The strength of the transverse Mercator projection, a cylinder wrapped around a sphere with the poles of the Earth sitting on the radius of the cylinder as compared to the Mercator used for nautical navigation where the equator sits on the radius, is that it roughly represents the plane occupied by a satellite image where: data collection is by a line scan device such as the Multiple Scan Spectrometer (MSS) and Thermal Mapper (TM) carried on the Landsat series of satellites. The satellite is in a pole to pole trajectory, also such as the Landsat series Further the adjustments to scale for each pixel can be calculated by assuming the central meridian for the transverse Mercator projection is the flight path, and that the extreme ends of the image are correct and the pixels towards the central meridian are magnified. In this way calculation of the scaling correction becomes a simple ratio of focal lengths problem. The correction grid can be used for both weighting, distance scale and area calculation, as the scale is constant in the direction parallel to the central meridian. Additionally, this gives a base for the application of a gravity correction to accommodate the departure of the ellipsoid from a sphere (Bougeur correction) and local perturbations in the orbit of the satellite (departure of the geoid from the ellipsoid). These modified C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 174 corrections only need to be applied at the time of integration of area and the original radiometric signals can be untouched until that time. For distance calculation each pixel can be assumed to be a vector of the minimum fraction of a unit (the scale at the central meridian) in the direction parallel to the meridian and the perpendicular displacement to be the scale factor. The distance is then a trigonometric reduction based on those scale factors. Before applying, to the display, polygons or points from government data, the longitude of each vector point of the vector file will need to be adjusted. This adjustment is necessary because the earth spins below the satellite. The adjustment is the integration of all the lines from the base of the image, which is south for a southward flying image, north for a northward flying image. The incremental adjustment for each line is the cosine of the latitude multiplied by the side-slip displacement at the equator. The side-slip displacement at the equator is determined by the time taken to collect a pixel and the rotation of the earth.
VICMAP and VICGRID Until 1998, VICGRID was called VICMAP or VICMAP (ANS). This Lambert Conformal Conic projection is best for showing elongate east west regions hundreds of kilometres wide, just like the state of Victoria. It was used for the Atlas of Victoria, 1:2 million and 1:4 million scale maps to show roads, towns, state boundaries, rivers, and catalogues of satellites.
Technical specification The VICGRID standard has two components, the projection, and datum. These are: Lambert Conformal Conic projection 2 standard parallels 36S and 38S latitude Central meridian 145E longitude For the spheroid initially Australian National Spheroid (ANS ~ Clarke 1866) was used but since 1998 the spheroid from the Geocentric Datum Australia (GDA94) will be found. The use of different spheroids is the technical difference between VICMAP and VICGRID. In detail there is less than 200 metres real
Geocomputing Management 175 displacement between the same coordinates when plotted on the two spheroids, so at VICGRID scales (1:2 million and up) there is effectively no difference. The geodetic datum GDA94 has been recently introduced so it may not be present in your computer program definitions. Use GRS80, the spheroid used for GDA94, or otherwise WGS84 is the next closest. WGS84 is the geodetic datum used for the satellite Global Positioning System (GPS) so it should be prevalent. As an example, most offshore seismic lines are surveyed to this spheroid, no matter which ocean. Table 48 cartographic spheroids sorted by geometry. name
spheroid geometry 1
polar radius
1/f
b=(1-f)*a metres
measured 2
a metres -
-
6356800
subequatorial radius a metres 6378200
6378137
298.257222101
6356752
6378137
6378137
298.257223563
6356752
6378137
6371160
298.25
6349798
6371160
GRS80 3 spheroid for WGS84 ANS GRS67
3
3
1924 International Ellipsoid 3 Clarke 1866 Airey 1830 1
page 78 of these “global” as compared to local or regional spheroids are geocentric: located on the gravitational center of the Earth, and also specify gravity constants and arc measurements. 2 3
The height datum is the same for VICGRID and VICMAP. This is the Australian Height Datum which gives the reference for elevation from sea level.
other projections in general use Often a geologist will need to incorporate other data, such as tribal boundaries, political and economic zones from state published maps. The government of Victoria uses many projections in publications and data sets but the main ones are shown in Table 49. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 176 However, in most regions you will find data using coordinates that have been taken directly from a GPS receiver. This will be especially the case if you are working directly from someone’s field notes. Unless the GPS receiver has been configured otherwise, these coordinates belong to the WGS84 system. Table 49 projections for government publications in Victoria official
informal or obsolete
name VICGRID MGA94, zones 54 & 55 Albers Equal Area Conic Albers Equal Area Conic (WGS84) AMG zones 54 & 55 VICMAP-TM geographic (WGS84)
use Atlas of Victoria topographic series Regional Geology 1:500 000 series salt maps, and working geology topographic series until 1998 satellite image mosaic GPS-aided data collection
definition page 174 page 168 page 172 page 172 page 168 page 172 page 175
Further information can be found at: VICGRID map projection; (2000) http://www.giconnections.vic.gov.au/content/docs/vicgrid/ VICGRID map projection; 2000. HTML file. Department of Land Information and RMIT University.
Ballarat cartographic module In this exercise the Layout window of ESRI ArcView acts as the cartographic module. However, there is an overlay for the 1:10 000 AMG supplied in the Ballarat GIS Data set, which can be very useful for plotting up old data against the new MGA mapping grid. This is given at: .\ballarat_GIS\ballarat_GIS2\gis\mapinfo_export\amggrid
The astronomy processing sub-system The managing of time and events is carried out in the astronomy processing sub-system. This history module contains the time-based information and I talk about history because there is usually some action or process being undertaken by humans. In the paper world this is where check lists and work journals come in. This type of data is not stored well in a GIS, and Microsoft Outlook is designed specifically for the task, but I use Microsoft Excel or paper (from Microsoft Word) principally, but most recently I have trialled Legacy
Geocomputing Management 177 Family Tree. If I am working for a client I spend a bit more time with the check list so that they are self-explanatory (as I need to justify my time). So I make them up in Microsoft Word, and Table 50 is an example and there are many others in this document. The idea is you print them off, mark them, write the date of the work, and file them in your work journal - a large two-ring folder. We don’t have to be be physically working on the goldfields around Ballarat (as much as we would like to). There is production data from people who have, and we can use a spreadsheet to show this. If it is more historical, such as Ken Grubb’s work with abandoned coal minesk, there is biographic data and bibliographies, so something like Legacy Family History would be more suitable. These experiences are described in the following sections:
k
Paper check list Geological Survey Victoria VICMINE database Spreadsheet schedule Production history for the Ballarat earth model See also “Time and expense account” from Chapter 4.
{Grubb, 2014 #274}
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 178
Table 50 uses for an astronomy processing sub-system work
date: Microsoft Excel Microsoft Word Microsoft Outlook Legacy 8 Family Tree COMPONENT attribute
need
*
CHECK LIST show structural programming of sub-activities
3
4
1
2
compact presentation for filing in work journal
3
4
1
2
*
JOURNALLING as per Table 101 and Table 102 count time spent on a document
*
2
1
3
3
export the time for accounting
4
2
3
1
tally the time
?
2
3
1
MINE HISTORY
*
recognition of Gregorian calendar
1
2
4
3
recognition of another calendar: Julian, Islamic or astronomical
3
3
2
1
bibliographic records
1
4
2
3
biographic records
1
2
3
4
time charts
1
4
3
2
geographical location of records
1
3
4
2
exports automatic documents and composites them into a booklet
1
4
2
3
curate photographs onto a museum web-site
1
2
3
4
LEGEND 1 4 ? *
Best at this attribute Worst at this attribute Have not had an opportunity to use this function the pick of the applications for this component
Paper check list In draft 11 of 2005, the large and more complex data tables of previous drafts were moved to the ‘Computers in Geology’ table
Geocomputing Management 179 serverl. Where this has occurred there will be pointer to the direct web address of that table. The remaining tables were turned into check lists and these you can print two pages to an A4 page, or print the A5 page in the corner of the A4 page for extra editing space. I have also tried to have the associated references as footnotes so that you can keep the check list in a folder as a record of your processing. To print out the check lists two pages to an A4 sheet with the binding gutter on the outside, you can put these in a clipboard, the clip occupies the gutter margin, and leave on it on your lap while you use your laptop propped up on the dashboard (still plugged into the cigarette lighter). The example commands to do this are Equation 5. Equation 5 printing out two pages of check lists File | Print… Pages: 177-178 Pages per sheet: 2 pages Scale to paper size: No Scaling
In the second method, I print the A5 checklist on a single A4 page, and I use this where I am adjusting or modifying the check list or where I think I will need a lot of additional notes. The broad margins to the right and bottom of the checklist give me plenty of room for additional notes, edits and layout improvements – lots of arrows and scribbled notes. The final mad scrawl can be filed into a single folder to act as a work journal and is a more structured record of the work (usually there is a date and some files names at least) than if I had written it free form in a notebook. In writing this book I also use these check lists. If I have new work and I think it will resemble work I have done previously, I look it up in procedural order, take the page number/ table references and find the adjacent procedures. These often have already been updated, from another task, in the latest version; and I modify them further. In this way I get more general procedures, make the check lists more fact rich, and find opportunities for scripting repetitious tasks.
l
The URL for the Computers in Geology table server is http://www.grantjacquier.info/develop.htm C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 180
Geological Survey Victoria VICMINE database The GSV VICMINE database contains firstly the location, name and unique code for Victorian mines in the master.txt file and secondly the gold production versus unique Victorian mine code in the prodtot.txt file. Both these files can be found on the Ballarat GIS Data at: .\ballarat_GIS\ballarat_GIS2\VicMine\master.txt
.\ballarat_GIS\ballarat_GIS2\VicMine\prodtot.txt
Spreadsheet schedule I like the speed of an adjustable work programme, or at least keeping all the actions together, so I use a column of actions against some kind of date selection across the rows in a Microsoft Excel spreadsheet. There is some variation to how you use the date, and I have given these examples in Table 51.
There is the straight column of action and column for date which is the bank book format and I still use this for share transactions. The series of ‘month and day only’ columns are of course representing the Solar cycle, ideal for working bees where you have annual tasks depending on the season, and you mark off those tasks in the appropriate season column, you can even simplify it by using months or quarters. The Latitude axis is a little bit more cryptic but the assumption is the field season is only at certain times in the year and you can use the latitude of the field site as a unique indicator of what you should take, one column per latitude, marking which latitudes require that clothing as per the example spreadsheet StudEx.xls file. The use of day, that is day 1, day 2 and so on, is used for any building exercise, which repeats the steps on every site. And for those larger developments like mines, you can use a series of columns one for each year either numbered as in net-present-value budget or calendar as in mining production versus metal (which generally for a particular mining district equates to a particular metallurgical process).
Geocomputing Management 181 Table 51 time axes versus action for spreadsheets Type of time axis Day, month, year 3 day and month only (or month, or quarter) Latitude/season Day 1, 2, 3, etc Year (either as a span: 1, 2, 3…2; or named: 2008, 2009 etc) type of list
tick
Your list type: Check list for packing field equipment 1
X
Share transaction register
X
net present value budget for a mine
X
Mining production for a district
X
Schedule for a water-bore work-over rig Check list for working bees
X X
The type of your time axis: NOTES 1 The example of a check list for field equipment packing is available on the Computers in Geology website in the file StudEx.xlsm 2 Brown in 2010n tells that a year is being discussed by the International Subcommission on Stratigraphic Classification as a unit for a span of time exactly 31 556 925.445 seconds. 3 Labels for days don’t necessarily have to be complex names, Richards 1998o, recommends and uses the astronomical day, a signed real number, of the precise number of rotations of the Earth. I have put a calculator, based on his formulas, on my web site at the URL: www.grantjacquier.info/heritage.html#toy
Production history for the Ballarat earth model Using the spreadsheet Microsoft Excel which has quite a few built-in functions and arithmetic for the processing of time. We match that with mine production data provided from the Geological Survey Victoria, as per the ‘Geological Survey Victoria VICMINE database’
http://www.grantjacquier.info/StudEx.xls Cathy Brown, 'Geological time units - definition of the 'year'', The Australian Geologist no. 154 (2010), p. 8. o E G Richards, Mapping time, the calendar and its history (Oxford, United Kingdom, 1998). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM m n
Geocomputing Management 182 section. Load the VicMine data and then link it in Microsoft Excel. Equation 6 summarises the commands to do this. Equation 6 using VicMine data in Microsoft Excel File | Open | *.txt gaia\gis\ballarat_GIS\ballarat_GIS2\VicMine\master.txt Delimited Other “|” Edit | Copy Sheet1!J2002072.xls Rename “mines”
After loading and linking the data, in the sheet “mines” far left column put a lookup equation, and then follow up with the menu items for a pivot table to create the “analysis” sheet. Equation 7 using VicMine data in Microsoft Excel File | Open | *.xls C:\convert\j2002072.xls VLOOKUP(A2, production!A:E,3) Data | Pivot table Sheet3!A1 sum of “prodn” for “deposit sub-type” vs “mines size” Rename “analysis”
The arithmetic processing sub-system The arithmetic module is what is usually associated with remote sensing, geophysical or geo-chemical processing as with the examples in Table 52. This corresponds to the old work done on paper cross-sections and often at this stage the depth component of geological computer systems becomes important. Table 52 mathematics for geological problems after Berkman measurement basis ‡ mathematical analogue from Berkman 6.1 Formulae for solution of triangles
m
l
t
I
T
L
M
θ
ρ
Geocomputing Management 183 Kirk 2010p 7 6 7 6.2 Formulae for area, perimeter, etc of planar figures & surface area … for solids Fahey & Foley 1987q 7 7 7 6.3 Apparent dip in a direction Bailey et.al. 2010r 7 7 6 6.4 Tables of slope angles Kirk 2009s 6 6 6.5 Field grid spacing and elevation conversion table image kriging in Scarmana 2010t 5 5 6.6 Stadia VMO analysis 6 6 6 6.7 Airphoto scale nomogram … 6.8 Determination of the line of intersection 6.9 Graphical solution of the three point problem 6.10 Orthographic and Wulf…. base units of measurement length l, mass m, time t, current I, temperature T, luminous intensity L, amount M, as well as the supplementary units of plane θ and solid angles ρ. ‡ : dimension analysis from page 39 of Tennant, 1971u. Data source from Chapter 9. Geophysics of Berkman 1 : Physical properties and conversion factors 5 : radiometric survey methods and tables 6. seismic survey methods 7. down-hole survey methods
Once depth is considered the requirement for an elevation datum becomes more critical. Generally you will be relating your depths back to the locally established height datum, examples are given in Table 53, but you could also use your own benchmark and this was often the case for older more remote mines. Table 53 official height data. height datum AHD712 AHD661
scope Australia Australia
establish. 1971 1966
method mean sea level mean sea level
Kirk, 'Slopes - Part 1 of 2', no. M Fahey and P. A. Foley, 'In situ measurement of the coefficient of consolidation,' in European Conference on Soil mechanics and Foundation Engineering 9th (Dublin: 1987). r Brad Bailey et al., 'Prospect identification using AVO inversion and lithology prediction', PESA News no. 104 (2010), pp. 22-24. s Kirk, 'DHI seismic facies', no. t Gabriel Scarmana, 'Super-resolution Imagery', Position Magazine no. 45 (2010), pp. 42-44. u R. M. Tennant (ed.), Science data book (Edinburgh, 1971). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM p q
Geocomputing Management 184 Auckland (New Zealand)
Auckland 1946 Datum1 1 2
1946
mean sea level
see AHD71 can be out in the order of a metre from local mean sea level in remote locations as reported in.
While, drilling or geophysical logging it is quite unusual to have surveyors come in and pick up the top of casing for you and relate it to the nearest official benchmark, so often the ground surface is used. The ground surface is undulating and the relationship to mean seal level or temporary benchmark is not obvious and therefore must also be modelled. This is currently done most easily with digital elevation models or DEMs with some of the more extensive given in Table 54. Table 54 digital elevation models in order of sophistication. DEM (extent, epoch) ACE1 (global, 1999) GLOBE v11 (global, 1999)
resolution
basis
vendor
<4km
satellite radar altimeter.
www.cse.dmu.ac.uk
digital terrain elevation data; + national DEMs digital terrain elevation GTOPO301 30 arc sec. data; (global, 1997) + 8 national DEMs GEODATA1 9 arc sec. spot heights; (Australia, 1996) gravity survey elevations. JGP95E1 5 arc min. topographic data; (global, 1996) bathymetric data; digital terrain elevation data. TerrainBase1 5 arc min. topographic data; (global, 1995) bathymetric data. ETOPO51 5 arc min. topographic data; (global,1987) bathymetric data. 1 This description is taken from Hilton et. al. (2003)v 30 arc sec.
www.ngdc.noaa.gov
edcdaac.usgs.gov
www.auslig.gov.au
U.S. National Imagery and Mapping.
www.ngdc.noaa.gov www.ngdc.noaa.gov
Also at this stage you you reconsider the radius of influence of the themes that you use and in multi-spectral work, the bands of the images you have collected The chart in Figure 24 gives comparisons R. D. Hilton et al., 'Comparison of digital elevation models over Australia and external validation using ERS-1 satellite radar altimetry.', Australian Journal of Earth Sciences vol. 50, no. 2 (2003). v
Geocomputing Management 185 of detectors for which I have encountered specifications such as Geoimage 2009w. Quickbird panchromatic
Quickbird Band 1
Quickbird Band 2
Quickbird Band 3
Quickbird Band 4
Worldview-1
Worldview-2 panchromatic
Worldview-2 Band 1
Worldview-2 Band 2
Worldview-2 Band 3
Worldview-2 Band 4
Worldview-2 Band 5
Worldview-2 Band 6
Worldview-2 Band 7
Worldview-2 Band 8
pixel (metres)
10
1
0.1 300
500
700
900
1100
1300
wavelength (nanometres)
Figure 24 comparison of spectral frequency and average equivalent distance of a pixel for several remote sensors
'Geoimage Celebrating 21 Years,' (Geoimage, 2009). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM w
Geocomputing Management 186
analytical module for the Ballarat earth model The analytical module for our example of the Ballarat map sheet consists of the the themes shown in Table 55. Table 55 pick list of the analytical data themes for the Ballarat sheet earth model theme type data set digital terrain model .\ballarat_GIS1\mapinfo\dtm.* Air (Bouguer) gravity survey .\ballarat_GIS1\mapinfo\gravity.* site data any Microsoft Excel spreadsheet in columns NOTES These themes wwere from Ballarat GIS Data x and would be located on a mounted disk such as: gaia\gis\ballarat_GIS
tick
The steps in the work include:
Going to use ArcView Image Analyst (File | Extensions | Image Analyst
2. 3. 4.
Reprojecting the images with a world file Load DTM (raster) data as per Equation 8. Load your raster (Bouger gravity) data also in Equation 8.
Equation 8 loading raster heights and Bougeur gravity in ArcView Start ArcView File | Extensions | Spatial Analyst File | Import | TAB table Version 3.00 Charset Windows Latin 1 Definition table File “dtm.tif” Type “RASTER” File | Extensions | Spatial Analyst View |Add theme | Grid ncols 480 nrows 450 xllcorner 378923 yllcorner 4072345 cellsize 30 nodata_value –32768 43 3 45 7 56 2 5 23 35 45 65 34 2 6 78 'Ballarat GIS Data,' ed. Natural Resources and Environment (Melbourne: Crown (State of Victoria), 2001). x
Geocomputing Management 187 5.
Loading field data from Microsoft Excel as per Equation 9.
Equation 9 adding site measurements to the raster image in ArcInfo start Microsoft Excel with field data spreadsheet File | Save As | *.dbf start ArcView with your project (myproject.apr) Project | Add | Table View | Add Event Theme The only tricky thing is making the world file to keep all three themes in the same plain.The world file is used with raster data assuming a flat plane, and specifying the values required in Equation 10. Equation 10 specifying a flat plane x1 = Ax + By + C; where C = top right Easting y1 = Dx + Ey + F; where F = top right Northing
The values for Equation 10 are implemented in a file given by: textedit dtm.tfw 31 0 0 -31 769830 5905800
A D B E C F
The grammar processing sub-system Mining companies have tended not to place much store on in-house presentation; “image” products, such as annual reports, have been traditionally contracted out. Routine and technical reports do not require multiple fonts or mixed text and graphics on the one page…. Considering the sense of perspective and style displayed by the average geologist in his/her field maps, it is possibly fortunate that DTP is not more widespread….” Bettenay (1989) Those two paragraphs on desktop publishing from Bettenayy remain Bettenay, 'An overview of the use of computers in exploration in Western Australia. .' C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM y
Geocomputing Management 188 the best introduction. So “image” is not important, but what has happened most recently is that functions now support the “content” with grammar checkers (Table 56), bibliographic databases, custom dictionaries (Table 115) and catalog merging. In fairness to Bettenay these features don’t come from the DTP world but the programming world and subseqently DTP software is revisited in the “rhetoric” section. However in formal writing of a thesis Leach-Paholski z introduce the requirements listed in the section ‘Plain English’. Evansaa writing on the mechanisms in 1995, gives a whole chapter on “Making Your Word processor Work for You” and includes these sections which are features he finds of assistance:
Formatting & style sheets Spell-checks and grammar-checks References Tables Figures Table of contents Writing onto the screen Structure and the ‘outline’ views Saving and duplicates Keeping a master disk Joint authorship
As a definition: the grammar sub-system of geological computer system is used to convey critical issues to others outside your immediate science community. The software market is dominated by the Microsoft Office suite of applications, and I am no different, but I also use an add-in, Thompson EndNote, for the bibliographic index (Reference in the Evans book).
z
Carolyn Leach-Paholski, Thesis writing guide (Parkville, Victoria, 1995). David Gordon Evans, How to write a better thesis or report (Carlton, Victoria, 1995).
aa
Geocomputing Management 189
Table 56 grammar and style rules versus report type Account:
File:
Date:
glj
*.wpt
*.dot, *.dotx
TYPE OF REPORT as per “published reports with contributions by different mineral surveying occupations” 5 (HYPO)THESIS: Thesis writing EMERGENCY RESPONSE PLAN: Writing for an experimental procedure or field observation CATEGORY 1 Proofing option
tick
AutoCorrect Options Capitalize first letter of table cells
n
n
Ignore word in UPPERCASE
Y
n
Ignore word that contain numbers
Y
n
Ignore Internet and file addresses
Y
n
General grammar
Microsoft Word specific Writing Style: Grammar & Style: Grammar
Y
Y
Fragments and Run-on (page 16)4
n
Y
Subject-verb Agreement 2
Y
Y
Writing Style: Grammar & Style :Style
Y
Y
n
Y
Facies, geology
Y
Y
Syndrome, medical only 3
Y
Y
Use of first person (pg 49 of Evans 1996) Test words for dictionary selection
NOTES 1 try the menu commands ‘File > Options > Proofing’. 2 Subject-Verb agreements are required for all geology reports as per page 17 of Glover . 3 Syndrome in anything but medical use is jargon as described on page 51 of Evans 1996 4 The grammar requirements for a thesis are given in the section “Plain English” of Leach-Paholski 1995 5 The table “published reports with contributions by different mineral surveying occupations” was at http://www.grantjacquier.info/biography.html#table1
office software This Grimoire began as a printed page of references that I thought had significance for a geologist using a computer. It has since then C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 190 become an A5 book hand bound with a metal binder complete with plastic cover and cardboard backing page and then as an e-book. This has given me a few opinions discussed below on:
Page format File format
Further, I purchased WordPerfect Office as per ‘The “Toffee” computer system, 2016 to -‘ section and these things I liked:
Opens and writes Microsoft Word, Microsoft Excel and Microsoft PowerPoint file formats. Writes PDF files, complete with PDF desktop publishing application WordPerfect uses a conventional drop-down menu system, rather than a ribbon-bar. The drop-down menus, with a failing memory, remind me of where and what options are available. In the suite is a separate Corel photograph editing application which I can learn. I miss the editor which was initally included in the Kodak CD product. The Corel offering looks similar to that.
bibliographic database The weaknesses I have found with Thompson EndNote include that I tend to get confused when I adapt an existing template. For example I box up my Australian Journal of Earth Science into winebottle cartons and store it in the roof, using an EndNote database to summarise the contents. There is no specific template for a Journal, only a Journal Article where the Editor is left out, and I am not confident to edit the provided template, because I tend to lose the caption from the records as I move them around between revisions.
page format Even though we are working outside which is obviously very spacious, I often end up doing the paperwork undercover from the rain or in other places where layout space is limited, such as site or home offices and hotel rooms, so I have kept the Grimoire in A5 format. I find this particularly useful for the check lists. The smaller
Geocomputing Management 191 format continued to be effective when I loaded the Adobe PDF version grimoire.pdf file onto an SD card and used it on the Telstra T-Hub (a Technicolor tablet running the Android operating system and the ThinkFree PDF Viewer).
file format My typesetting has always been done in Microsoft Word, though the companion Glossary of Geological Computing has been stored in a text files, Windows Card file, Microsoft Excel and most recently a Thompson EndNote bibliographic database. In 2002 Franco Smargiani from StereoAid had visited and asked that any work I do, I keep in Microsoft Word, so that when I was confident with what I had, it would give them an opportunity to publish the Grimoire for Australian readers. In 2006 I began experimenting with Microsoft Office Document Image format produced from Microsoft Word. From 13 th draft in 2007 the MDI file has been available for download from the Computers in Geology website. This gave me an opportunity to get feedback from my clients, and practice what looked good in type. In 2011, Paul Maconochie wrote to me that Microsoft had simply removed the program for viewing .mdi files from Office 2007 and 2010. If I was able to save the Grimoire to an alternative, less proprietorial format (tif, pdf, doc etc), that would be appreciated. He had scanned the web for a reader, tried it and immediately got a virus warning so at that stage he gave up. I also hit that problem when I moved to Windows 7 but Microsoft Office 2010 has an Adobe portable document format (PDF) writer often used for documents and e-books. Paul’s comments prompted me to finish my notes on the migration to Windows 7, and so the “draft 17”/”Windows 7” edition was uploaded (six months ahead of schedule) in PDF format complete with bookmarks to help navigation. It does take about a minute to download but as I only do a new edition each year, you can just download it once and keep it on your laptop.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 192
The rhetoric processing sub-system However Ho and Rocket (1989bb), suggest that there are three categories of desktop publishing: word-processing, enhanced word processing and dedicated desk-top publishing as shown in Table 57. They thought at the time that differences between the capabilities were lessening, but what I have found is that the lower end wordprocessing has been transferred into other applications like Thompson EndNote, Microsoft Outlook amd Microsoft Script editor, which do other things entirely; and the high end dedicated desktop publishing software like Microsoft Office Publisher, does new forms of output such as business cards, posters, banners and Internet web-sites. The middle ground is being characterised by Microsoft PowerPoint replacing internal memoranda “typed up” in Microsoft Office. The capabilities they gave in 1989 still seem relevant to the new software. The three categories have a section on each with: 1) Microsoft Outlook and Business Contact Manager 2) Microsoft PowerPoint 3) Desktop publishing system
bb
Susan E. Ho and Gina M.I. Rockett, 'Desktop Publishing in Exploration. ,' in Computers in Exploration - Where we are now and where we are going, Seminar No. 7, Australian Institute of Geoscientists Bulletin No 9 (Perth: Australian Institute of Geoscientists, 1989).
Geocomputing Management 193
Table 57 desktop-publishing software categories date
software category and capability after Ho and Rockett (1989) dedicated desktop publishing custom type sizes and line spacings; automatic hyphenation, full control over positioning and text block size, text wrapping around irregular graphics, import of special graphics formats like EPS, TIFF, and PICT; image modification; spot colour, page overlays and registration marks enhanced word processing character spacing (kerning); discretionary hyphenation; tailored formatting commands; columns; facing pages, margin controls and headers, moderate control over positioning and text block size; graphics resizing; boxes, shading and line styles; templates word-processing multiple typefaces (fonts), type styles (bold etc), type sizes and line spacing, limited control over positioning and text block size, cut-and-paste of graphics; document zoom software suite component Microsoft Office 2003 Microsoft Office Word Microsoft Outlook
X X
X
Microsoft Office Publisher Microsoft Office PowerPoint
X X
X X
Microsoft Script Editor
X
X
Thomson EndNote desktop version Pocket PC version
X X
used by Ho & Rockett MacWrite 4.5 Microsoft Word 4
X X
X
PageMaker 3.0
X
X
X
NOTES
Microsoft Outlook and Business Contact Manager I have used a contact manager program since 1993, originally the Australian program Tracker on MS-DOS. Work functions that I was interested in were mail-outs, client dossiers, following-up and birthdays. I switched across to the Microsoft Business Contact Manager that was bundled with Microsoft Office because the integration with e-mail via Outlook was better. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 194 Subsequently I have articles in the Grimoire of Geological Computing which refer to this product and the section "software required to be supplied" features the buying guide for Microsoft Office including BCM with the check list in Table 26. The procedure to create a mailout, is in the section "A newsletter mailout" originally in paper and envelopes, but Microsoft 2010 makes this even easier to do as emailed PDF files. For the installation of MS Outlook and Business Contact Manager the section " Transferring Microsoft Outlook data" including Table 116 a check list to configure Outlook, and Equation 87, the apology and URL supplied by Microsoft where you can get Business Contact Manager for free on the provision of your Microsoft Office 2010 product code. For business recovery the section "Return the computer to communications use " gives steps you need to restore this software if your computer fails and you need to rebuild the system. It includes Table 134 which is the fact sheet of details that you can slip into your "panic folder" (the folder where you have all the details of your software, which you slip into laptop bag, so you can recover from a computer failure while on the road). See what you think about the "system", it is supposed to be written in non-IT language so scientists without computer experience beyond the basic MS Excel course can use it. I intend to persist with BCM so there will be an exit strategy available at a later date should Microsoft discontinue the product line.
Microsoft PowerPoint The predominance of Microsoft Office applications doesn’t mean there aren’t serious critics, for instance Collins (2005) cc quotes comments from Edward Tufte on the misuse of Microsoft PowerPoint by the National Aeronautics and Space Administration in the report into the Columbia space shuttle explosion. But their finding is to have a technical report in the place of the Powerpoint presentations used, again which can be written in Microsoft Word, perhaps with a Thompson EndNote add-in bibliographic database as this book has been written. Collins on advice from Tufte saw the critical issue with PowerPoint is cc
Luke Collins, 'The presentation tool Powerpoint is killing our capacity for conceptual thinking, says it
nemesis, Edward Tufte', AFR Boss no. (2005).
Geocomputing Management 195 to substitute a few bullet points for more intensive data summaries, that is graphs and diagrams with plenty of data. All this is available in Microsoft Power Point object inserts, so once again it is a case of how you use it, not what you are using. Also beware of the ex-teachers who swear you should have no more than seven points on a page. This is advice is in the context of teaching children who would rather being playing outside or bored salesman who would rather be seducing their secretaries. The work of the cartographic research unit at the Defence Science and Technology Organisation, as outlined in a talk by the unit’s leader Major Bob Edwards at the University of Melbourne in 2001, showed that trained observers can handle and expect or feel more comfortable with higher densities of graphical information. This principle has been proved in battle with the unit’s mobile cartography being employed in the second East Timor crisis which lead to independence, and the Australian Army soldiers being able to detect differences in interpretations of borders with the Indonesians (they were using old Dutch colonial data, the Australians used official Indonesian data) and prevented a war with Indonesia.
desktop publishing system Ho & Rockett saw the benefits of a desktop publishing system as control, security, convenience and cost. Control because it is used by a scientist for his own needs. Security because confidential work is carried out by the scientist and this also prevents plagiarism. Convenience is because there are no delays of transport, or misunderstandings with commercial printers. Cost is because changes are a matter of time, and cost penalties are not applied. Apart from the ease of the inserting a bibliographic reference into a document, that comes from being a Microsoft Word add-on; I see the strengths of the bibliographic software Thompson EndNote as: there are provided templates for publications with each field labelled with a specific and informative caption, and the customised editing functions allow you to change things such as publication date in a block of references. In the mindset of Ho and Rockett, the alternative to a desktoppublishing system was getting publications typeset and they used C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 196 professionals when they were worried about appearance, or eonomics. Appearance was critical, because professionals have more typefaces, styles and graphical elements to transfer the message to perhaps an inattentive reader. For economy they saw the craftsmen able to employ denser materials and design with less paper and less transport costs.
The music processing sub-system The mathematics of understanding patterns of the earth is geophysics On my Geoscience Gateway web-site is a tabledd intended to replace the table of algorithms in the The analysis & processing phase chapter. It demonstrates extracts from a Thomson EndNote file grimoire.xml which contains a selected bibliography from this e-book. The intent with the XSL(T) translation file algorithm.xsl is to select only those references which have annotations regarding algorithms used for processing. Ultimately there will be a table of references to answer the question: "What can I do with the geoscience data I have?". This is all because there are too many to list in any book, even the humble photographer still has commercial value as the Eagle Research Advisory web-site www.eagleres.com.au showsee. When it does come to publishing the results there is opportunity with modern software to adjust the results in image post-processing. While “PhotoShopping an image” is a derogatory phrase for scientists, akin to hoax photographs of the Loch Ness Monster. In fairness all photographs were adjusted in processing and printing, as introduced in The Darkroom Principles of the Joy of Photographyff with:
Two of the most rewarding and enjoyable aspects of photography are processing film and making prints. Since you can exercise considerable control over the final image in a darkroom, many photographers feel that creating an image only begins when the shutter is snapped. Developing and printmaking complete the repertoire of of skills you need to produce images that express your personal viewpoint. dd http://www.grantjacquier.info/clipart.htm#table_layout ee
{Jacquier, 2011 #222}
Geocomputing Management 197 I had been content in using the image editor supplied with Microsoft Office (called Picture Tools in Microsoft Office 2016). In 2016 I had also started using LinkedIn Articles as the latest incarnation of the Computers in Geology newsletter, and the photograph editor there was less than what I had used before, so I looked favourably to Corel After Shot 2, for post-processing of my digitised photographs. For further comparison, the Basic Printing Controls from the Eastman Kodak Companyff are listed here, and give my preference for image post-processing in Table 58:
The physical cropping by moving the easel and changing the height of the enlarger head. This applies in the digital world with for example Golden Software Surfer, where base map images can be cropped and zoomed precisely by the limits of the plan given as coordinates and scale in that projection. The physical burning-in masks most of the print to give more exposure to part of the print. GS Surfer 12 introduced base map image adjustment, so with the previous blanking file function this is available for digital images. The physical dodging uses a partial mask to reduce exposure to just part of the print. As with burning-in the GS Surfer 12 base map image adjustment is via a colour table and intensity, though the dithering or air-brushing into the unadjusted image is superior in Corel After Shot 2. The physical vignetting uses a mask to remove the outer edges of the photograph. GS Surfer is the best digital example, where a blanking file can be determined from geophysical, geological or geographical parameters and applied to the base image. tip on parallax correction by tilting the easel during printing. This is best in Corel AfterShot 2 which provides a series of signal processing algorithms to affect objects within the image, whereas GS Surfer just has a viewing angle and point-of-view adjustments for the whole image in a plane.
Table 58 audit of image post-processing software software package:
date: Basic Printing Controls
ff {Company, 1979 #273}
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 198 parallax correction by tilting the easel during printing vignetting uses a mask to remove the outer edges of the photograph dodging uses a partial mask to reduce exposure to just part of the print burning-in masks most of the print to give more exposure to part of the print cropping by moving the easel and changing the height of the enlarger head your image post-processor: GENERAL (*.bmp, *.png, *.jpg, *.tiff) 1 = LinkedIn 3 = Picture Tools (in Microsoft Office 2016) 5 = Microsoft Paint (in MS Windows 10 and before) 8 = Golden Software Surfer 10 and before 12 = Corel After Shot 2 (with WordPerfect Office X8) 15 = Golden Software Surfer 12 MyEasyPlot EasyPlot GEOPHYSICAL (*.img, *.CGM + PIP extensions) LEGEND n function not present Y function is present ? function is expected to be present, but not reviewed 1 Comparison of functionality, the higher the better, 1 is the worst 1= Preference expressed as the sum of functionality comparison numbers
1 3 2 5 4 5 ?
n n 1 n 2 3 ?
n n 1 n 2 3 ?
n n 1 3 2 3 ?
n n n n 2 1 ?
Geocomputing Management 199
Using an ore system on an earth model Perhaps the key precept that distinguishes geology from other earth science disciplines is the thought that there is some innate logic to earth processes and the resulting substance. It has probably descended to modern geologists from the early theologians who took a practical approach to supporting their belief in the flood myth. The principle is still current, and scientists in the 1990s turned their attention to the geological processes that occurred in the history of mineral deposits. This particular type of geological history has been labelled an ore system [White 1997 gg uses the source-migrationtrapping combination on page 28-29], with examples from other authors given in Table 59. An ore system commonly has the components: ore fluid generation, ore fluid transport, ore fluid trapping and ore concentration. It is equally applicable to oil and gas exploration with the components being labelled hydrocarbon generation, hydrocarbon transport, hydrocarbon trap, integrity of the cap and reservoir quality. There are currently five practical reasons why we should be using an earth model as the basis for any geological work. The reasons in order of importance are: 1. Optimise the return on difficult, expensive fieldwork (undersampling is institutionalised in our management practices.) 2. Multi-disciplinary studies 3. Data currency (1998 Newcastle colliery disaster) 4. Data is not independent (i.e. it is part of the story) 5. Trend to holistic facies-based studies
gg
White, Management of mineral exploration. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 200
Table 59 possible Pangaea/Gondwana/Australia ore systems1 yield Au Au Fe Cu Cu diamonds heat heat heat heat Ni Ni Sn, W Ta U Zn, Pb Zn, Pb Zn, Pb
ore system Orogenic gold systems 1 Porphyry associated gold (copper, silver) systems 1 BIF-hosted iron ores 1 Iron oxide copper-gold systems 1 Metamorphic copper systems 1 Kimberlite-lamproite pipes 1 Geo-pressured brines 2 Hot dry rock (HDR) 2 Hydrothermal 2 Magma associated with active volcanoes 2 Komatiite-hosted nickel systems 1 Mafic-ultramafic intrusion associated Ni-Cu (± PGE) systems 1 Felsic intrusion-related Sn, W and rare metals 1 Tantalum (-lithium) pegmatite systems 1 Unconformity related Uranium deposits 1 Proterozoic sediment-hosted, stratiform Pb-Zn-Ag systems 1 Carbonate-hosted, strata-bound lead-zinc (MVT) deposits 1 Volcanic (felsic intrusive)-associated massive sulfide (Cu-Pb-ZnAg-Au) deposits 1 Syndeformational, sediment-hosted, Au-Cu-Ag-Pb-Zn deposits Zn, Pb (Cobar-type) 1 1 from Jacques (2002)hh 2 from Alexander (2005)ii
I like the combination of the ore system with an earth model, because you can have several scenarios, and a complex history can be built up from repetition. The key advantage over traditional narrative is that the ore system has an emphasis on quantitative estimation to allow economic evaluation at the end of the investigation. My personal interest is that the metaphor of a fluid interacting with a mineral resource can also be used for human
A. L. Jaques, S. Jaireth, and J. L. Walshe, 'Mineral systems of Australia: an overview of resources, settings and processes', Australian Journal of Earth Science vol. 49, no. 4 (2002). hh
ii
Elinor Alexander, 'Geothermal energy exploration in South Australia', PESA News no. 73 (2005), pp. 39-52.
Geocomputing Management 201 activity. While I am confident that urban sprawl can be modelled jj, I was surprised how well the planning of my mother’s Alzheimer’s treatment (fitted within a multiple stage, multiple phase, multiple scenario ore system) was represented in a spreadsheetkk. In terms of computing, while you can do it in a single spreadsheet, the ore system will likely be a suite of computer programs, which are applied to the earth model data. However, unlike many computing applications in commerce, where the methods of banking haven’t altered in hundreds of years, the processes described by the computer algorithm needs to be altered, as more knowledge is gained and opinions change on the underlying geological system. The scientist’s thoughts about the ore system and subsequently the associated computing applications will pass through the classic exploration life cycle shown in Table 60. Also shown in this table, are the key data management issues addressed by the computing application at each stage. If you manage your computing correctly it should improve in capability at the same time as your investigation changes. In Willison 2012ll, who uses frameworks similar to White writes:
“Academics have also found that this process has influenced the ways they themselves think about research and for some, even suggested fresh research directions.”
jj
Grant L Jacquier and Joseph Leach, 'A compound, precision oriented, relative accuracy index for the comparison of raster data and the minimalisation of computing cost,' in 5th international symposium on spatial accuracy assessment in natural resources and environmental sciences, ed. Gary J Hunter, Kim Lowell, and Rod Allan (Melbourne: 2002) G. L Jacquier, J. Leach, and I. D. Bishop, 'West Gippsland Catchment Monitoring ' in 18th Australian Geological Convention Abstracts (Melbourne 2006: Geological Society of Australia, 2006) Grant L. Jacquier, Joseph H. Leach, and Ian D. Bishop, 'Specific characteristics of data used in monitoring images for West Gippsland catchment management, Victoria and the significance for spatial data infrastructure.,' in International Symposium on Spatial Data Infrastructure (SDI), ed. Abbas Rajabifard, et al. (Parkville, Victoria: Centre for Spatial Data Infrastructure and Land Administration, the University of Melbourne, 2001). kk The ‘Alzheimer’s treatment’ [extreme example] ore system is found at: www.grantjacquier.info/development_files/sheet006.htm ll John Willison, 'Students becoming geoscientists, geoscientists becoming renowned,' in 1st Australian Geoscience Teaching Workshop, ed. Mark Tingay, et al. Abstracts (Adelaide, Australia: Geological Society of Australia, 2012). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 202 I am always losing White's description of the exploration life-cycle so I have typed it verbatim in Table 60. I was struggling to think how the "levels of student autonomy" from Willison’s RSD/RSD7/WSD would be represented for White but then realised it is very easy:
there are several levels of acceptance in a mining approval process based on knowledge, and we often talk of a project "standing alone" if it is likely to attract final investment decision without further work. You could consider the language transitions from scientific (1) to legal (5), with engineering and accounting in between. You could invoke the RSD7 for a mine which has been approved and then makes an impact on the economy giving two further stages production and rehabilitation both public activities.
In exploration we also think in terms of information being equivalent to money or commodity production, as we don't physically touch the metal but rather "prove it" with more documentation. Anyhow, the first section of this chapter discusses each of the six phases of information and technology management and how they apply to building up the ore system. The second section gives example computer applications for an ore system in the region of Ballarat in Victoria.
Geocomputing Management 203
Table 60 life cycles for exploration, research and communication versus computing focus Exploration Facet of inquiry: teaching 2 and Facet of inquiry, communication 3 Information & Technology Management management1 research 4 regional research Embark, determine a need (A) INITIATE (A) reference & indexing field work Find/generate (B) TECHNOLOGY (B) field data & validation preparation of results Critically evaluate (C) LEARNING (C) analyses & processing project review Organize (D) MANAGEMENT (D) corporate information & data sharing proposal for further work Synthesise, analyse and apply (E) PROBLEM SOLVING (E) summary & presentation statutory reporting Communicate (F) INTERPERSONAL COMMUNICATION (F) archive & reporting NOTES 1 mineral exploration life cycle from pages 35 and 36 White (1997)a given as i. The first stage will be a small budget program to “have a look” this usually involves geological reconnaissance – checking that the geology in the exploration tenement really is as described on maps – and some preliminary geochemical sampling. ii. The second stage will depend on encouragement from the reconnaissance work, and could involve geological mapping, systematic geochemical sampling (which may include rotary air blast [RAB] or shallow drilling through cover), and geophysical survey. iii. Likewise the third stage will depend on encouragement from the second stage, and after the data gathered in the second stage is digested and interpreted, further geochemical surveys and/or geophysical surveys may be decided on, or the program may proceed directly to the drilling of selected targets Further work depends on the results of the preceding exploration. There should be an ongoing analysis and and rigorous assessment of the results to justify more expenditure. Many prospects will are abandoned when they fail to measure up against other prospects in attracting enthusiasm and expenditure commitment from the financial decision makers 2 teaching stages from Research Skill Development (RSD) framework, a conceptual model to make explicit the incremental and cyclic development of student research skills, pages 7 to 8 of Willison (2009)b
White, Management of mineral exploration. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM a
Geocomputing Management 204
communication/negotiation stages from Work Skill Development (WSD) framework, Appendix 2 of Willison (2009 b) Doctorate of Philosophy research stages from Researcher Skill Development (RSD7) framework, a conceptual model for the development of student and researcher skills, URL given on page 12 of Willison (2009b) as www.adelaide.edu.au/cpld/rsd/rsd7 3 3
b
Willison (ed.), Handbook for research skill development and assessment in the curriculum.
Geocomputing Management 205
The Ballarat sheet earth model This exercise uses real data from the region around Ballarat, Victoria, and because this is an historic mining province there is data of all types suitable for all disciplines. Hence it is ideal to demonstrate the earth model approach. The data set is provided straight from the Geological Survey of Victoria Ballarat GIS Data. This a 2 CD-ROM set and these can be copied to a common drive as: “Ballarat GIS Data DISC 1” and “Ballarat GIS Data DISC 2”. There should also be a data catalogue (for example j2000080.xls ) and a local work area, such as c:\convert, to improve the performance of your personal computer and prevent any overwriting of the source data. The spatial extent of the earth model has been determined by the Geological Survey of Victoria (GSV) and is formally the Ballarat 1:100 000 sheet (ANZLIC code 7623 ). The temporal extent is from the year 1852, when the GSV was formed, to February 2001, when the last of the data sets on the CD were compiled. As we are working with a geological model there are at least also limits to the stratigraphy, and the depths investigated. However, these are not as readily apparent or defined in a GIS and this is why this type of software is not as readily accepted into oil exploration as say gold exploration.
The development phases of a Ballarat ore system The section discusses the different phases of the exploration lifecycle (Table 60) for the case study of the Ballarat map sheet region. The exception is “field data and validation” which is covered in the “Why use an earth model?” section. The example used here involves a bit of role-play to dress out the problem. Consider that you are working for a:
Gold exploration company You have experience in the Eastern Goldfields, W. Australia. Prospects are exhausted there and you are looking elsewhere
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 206
The reference & indexing phase The first phase for any work is the “reference & indexing” phase and this corresponds to regional reconnaissance work in exploration. It is also the time to establish good data management practices, as Johnson reported in 2011a that “geoscience data is essential for scientific investigation” as well as:
managing geological hazards, land use evaluation and classification, civil engineering projects, formulating government resource policy efficient exploitation of natural resources.
Johnson in 2012b divided the data into three categories: geoscience collections, non-digital geoscience data and digital geoscience data; with the “range” from Johnson (2011) including:
samples of drill cores, stream sediment, rock chips, soil and water; assay results; field notes; images such as photographs, plans and videos; geological maps; airborne exploration surveys, such as aeromagnetic surveys and digital terrain mapping; remote sensing, such as aerial photography, radar and satellite imagery; ground geophysics, such as radiometrics, seismic reflection, electromagnetics, well logging; and 3D modelling produced by a variety of proprietary software.
She defines “geoscience collections” as “items which originate naturally, including geological samples such as rocks and drill cores” where as “non-digital geoscience data” is for “physical items such as Johnson, 'The Role of Information Professionals in Geoscience Data Management: A Western Australian Perspective'. b Johnson, 'The Role of Information Professionals in Geoscience Data Management: A Western Australian Perspective'. a
Geocomputing Management 207 hardcopy maps and field notebooks”. Here I will deal with mainly the third category of “digital geoscience data”. The types of data in this category are given in relative occurrence from the surveys of Johnson in Figure 25.
drilling / well geochemistry geophysics GIS images interpretations maps, plans mine & mineral deposit models other documents
Figure 25 the relative occurence of digital data types in the surveys of Johson Probably the most obvious information aspect of the approach in this Grimoire is the use of a thesaurus of key words as per the sample for Computers in Geology in Table 61. This is essentially the use of common or approved words in labelling your documents as you create them, means they will sort together when it comes time for reporting and review. The several issues or questions to be considered when establishing a thesaurus for geology use are:
scale projection time stratigraphy cost format extent geological history
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 208 Digital tools available for the work, and some broad objectives that will apply in most cases are given the sub-sections attached to the challenges given by Johnson’s Figure 6.12 (Challenges of geoscience Data Managementl), along with their occurrence in the survey participants (both information professionals + others): 1. TECHNOLOGY: (4 + 4) see the sub-section below on Electronic reference and indexing 2. FRAMEWORKS (4 + 3) see the sub-section below of “Reference and indexing for a Ballarat ore system” 3. AWARENESS & ATTITUDE (5 + 1) 4. PRESERVATION (4 + 2) 5. DATA VISIBILITY & ACCESS (4 + 1) 6. RESOURCES (3 + 1) 7. DATA VOLUME (2 + 2) 8. DATA RANGE & COMPLEXITY (2 + 1) 9. TRAINING (2 + 0)
Geocomputing Management 209
Table 61 sample conversion of key words into project codes category (from Keyword field on File > Properties)
project
1
unallocated
Affinity Contracting & Search
Perentie
AGIA
societies
applied mathematics;civil engineering;geology;statistics
Perentie
Australian Geoscience Information Association
societies
Computers in Geology
administration
geology
societies
Geological Society of Australia
societies
GSA
societies
investment
investment
Pembroke School
private
private
private
Project Numbat
Numbat
Project Perentie
Perentie
Project Wombat
Wombat
Santos
Santos
Specialist Group in Computing
societies
The Regency Lodge
private
The University of Melbourne
Numbat
zzz
unallocated
Electronic reference and indexing The general tools available to meet the issues for using a geology thesaurus with documents are:
readme file data dictionary browser catalogue
The objectives for a reference algorithm to work are
read meta-data run browser
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 210
make catalogue
Reading the meta-data is basically appreciating the contents of a data file or database that is available to you. Twenty years ago this was perhaps just a sensible naming convention for data files in directories but increasingly complex descriptions are now available in the headers of these files. In Table 62 are some of the more specific geological standards available for indexing but it does illustrate that contents descriptions can vary from key words in a thesaurus to a process description that indicates the topology or inter-relationship of blocks of data both in time and space. The next step browsing of the meta-data is allowing the scientist to make comparisons between the data sets once the contents of each file have been read. And finally the catalogue, is the list of the of the best available data sets to be used for the work ahead, ignoring any data from the data collection that is not quite relevant, making a subset that can be used efficiently by the whole team.
Geocomputing Management 211 Table 62 electronic file indexing schemes for geology THESAURUS meta-data schema
basis Dublin Core XML AGCRC1 Dublin Core Geography Markup Language(GML)3 XML CGI Geology Data Model (GeoSciML4) GML Extensible Markup Language (XML) 5 SGML Standard Generalized Markup Language (SGML) 5 ISO standard Extensible HTML (XHTML) 5 XML, HTML Exploration and Mining Markup Language(XMML)3 GML Hypertext Markup Language(HTML)5 SGML Virtual Reality Markup Language(VRML)2 MapScript Scalable Vector Graphics (SVG) 3 TOPOLOGY 1 introduced in Price & Stokerc 2 introduced in Pullar d 3 outlined in Ackland & Coxe 4 announced in Cox & Simonsf from the work by the Commision for the Management of Geoscience Information (CGI) of the International Union of Geological Sciences 5 differences between XML, HTML, XHTML and SGML are given on pp4-7 of Ray & Rayg
Reference and indexing for a Ballarat ore system The outcome of this section is a strategic report to a shareholders meeting summarising your regional reconnaissance. We have to get our facts straight so we can answer their questions. First we summarise our geological thinking, then make some approximations to extrapolate a mathematical model from which we can derive some numbers to table at that meeting (recorded in a Microsotf Excel spreadsheet tagged with appropriate key words for the project). In establishing a regional geology model let us believe the Eastern Goldfields, and Victorian Goldfields are cratons caused by identical continental – island arc collisions. However, if we trust Bierlein et. al. G. P. Price and P. Stoker, 'Australian Geodynamics Cooperative Research Centre's integrated research program delivers a new minerals exploration strategy for industry', Australian Journal of Earth Sciences vol. 49, no. 4 (2002). d D. Pullar, 'Using VRML to visualise landscape change and process', Cartography vol. 31, no. 1 (2002). e Ross Ackland and Simon Cox, 'Markup mapping.', GIS User no. 47 (2001), pp. 28-31. f Simon Cox and Bruce Simons, 'CGI Geology Data Model Working Group', The Australian Geologist no. 137 (2005), pp. 25-26. g Deborah S. Ray and Eric J. Ray, Mastering HTML and XHTML (Alameda, CA, USA., 2002). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM c
Geocomputing Management 212 (2001)h, in the Eastern Goldfields the majority (>51%) production is from orogenic deposits, whereas in the Victorian Goldfields this is mainly placer and alluvial deposits. Let us assume:
Company finding rate is 1:200 all non-orogenic deposits discovered most orogenic deposits hidden by soil cover and not discovered . In 1999, Victorian Government financed state-wide air geophysics.
To put numbers on the regional model, to give us a maths model, you open the Microsoft Excel spreadsheet as per Equation 11, and then apply the following columns:
Total production of all subtypes (PD) fault hosted production (PO) non-orogenic production (PN = PD - PO) potential production (PP > PN / 49%) undiscovered production (PU > PP - PD) Return to shareholders (Pf > PU x 1/200)
Equation 11 using Microsoft Excel for a regional maths model start | All Programs | Microsoft Office 2003 | Microsoft Excel File | Open | j2002072.xls
BIERLEIN, F. P., ARNE, D. C., KEAY, S. M. and NAUGHTON, N. J. 2001 Timing relationships between felsic magmatism and mineralisation in the Central Victorian gold province, southeast Australia. Australian Journal of Earth Sciences, 48, 883-899. h
Geocomputing Management 213
The loading data & verification phase This section could be entitled “Field data & validation”, especially if working directly in the field but for a lot of the time the computer geologist is concerned with historical or legacy data. Subsequently, the preparation of the earth model (especially the logic sub-system) covers this quite well for the legacy data, though you will want to use the suggestions in the sub-section ‘Statistics for field data’ to validate that old data. With that caveat explained, the rest of this section will deal predominantly with data collection. The data collected can be analogue measurements, digital readings, narratives, or illustrations. Essentially, different number bases, such as base 2 or binary, can represent a number. In computing there is also base 8 (octal), base 10 (decimal) or base 16 (hexa-decimal). Alternatively a symbol can be associated with each number such as HTML and ASCII. Translation can go both ways from symbol to number or number to symbol which leads to the hybrid representation of Binary Coded Decimal or BCD. On the ‘Computers in Geology’ table server you will find a table to translate between different codes at the Internet address in Equation 12. Equation 12 URL for code translation http://www.grantjacquier.info/develop.htm#translate
I still prefer paper for field work, and in 1996 I put those thoughts into the Autumn 1996 ‘Computers in Geology’ newsletter i, which David Stapledon summarised in the section ‘4.4 Equipment and Programs Suitable for Logging” of his keynote address j, later that year. Nevertheless computers are used in the field, Dentith in 2008 gave a primerk, with other papers I have come across but not yet integrated into this narrative are:
Gasmier (1987) Holloway (1999)
Grant Jacquier, 'Computers in Geology,' in PESA News (Computers in Geology, 1996). Stapledon, 'Keeping the "Geo"; Why and How.' k Dentith, 'Introducing digital geological mapping into a 3rd-year field unit: experiences at the University of Western Australia', no. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM i j
Geocomputing Management 214
Waltho (1999)
From my perspective a lot of what is required for data collection can be seen in surveying systems for engineering at site scale, cadastral surveying for terrain and basin scale, with geodetic work for geophysics and regional mapping at continent scale. However, I expect there are some special characteristics and I interpreted these constraints from a critique of the Mangocreations iGeolog software by Cockbain in 2011l which “basically consists of a geological section editor”:
l
Good on-line help is required. Setting precise bed thicknesses is very difficult if you have to rely only on graphical means such as a slider. This echoes comments made by Bettenay in 1989 m with “it is the inherent design and interface that determines the practical effectiveness of a software package for exploration, not the range of features it offers”. Accessing catalogues of fossil marks has to to be easy, prefereably with some kind of automatic assistance, that doesn’t require practice. Curiously Stapledon in 1996 is more scathing of the actual codes for shading in geotechnical logs as proscribed in the Australian Standard of the time, than of the actual computer being used. So probably the future of geological data collection software will be that it will handle the log annotations and artefacts better than we can do currently with pencil. There needs to be transfer utility and destination for the information once you have made the section. A screen shot to JPEG file is not good enough especially when you have a section which exceeds the screen size. Previously had celebrated Micromine where all data files are ASCII (American Standard Code of Interface and Interchange) and can be re-used, even in an algebraic sense with labels such as “NS” and “Stope” being treated as missing values (he uses the term “logical null”). There is a trade off of weight versus the size of the screen which makes the application more useful.
Tony Cockbain, 'iGeolog, Mangocreations', The Australian Geologist no. 158 (2011), p. 40. Bettenay, 'An overview of the use of computers in exploration in Western Australia. .'
m
Geocomputing Management 215
Statistics for field data This sub-section is a ready reference of Microsoft Excel formulas for setting up statistical calciulations in a worksheet based on what you know about how the data was collected. I find it useful when I am bringing data together from different sources into an earth model. Each set has different assumptions, and so requires different statistics. The sub-section is in two parts, the first dealing with integer values, or more precisely discrete distributions, where all the permutations are known; and the second is for real numbers, or again more precisely continuous distributions, where obviously the values are samples and having the complete collection is impossible. Discrete distributions: 1. Equation 13 binomial distribution of a population 2. Equation 14 binomial distribution of samples by a Normal model 3. Equation 15 discrete geometric distribution 4. Equation 16 uniform distribution 5. Equation 17 Poisson distribution of elapsed time 6. Equation 18 Poisson distribution of counts per second 7. Equation 19 Gaussian distribution Continuous distributions: 8. Equation 20 uniform distribution of a continuous variable 9. Equation 21 Poisson distribution of a continuous variable 10. Equation 22 Standard Normal distribution of a continuous variable 11. Equation 23 Normal distribution of a continuous variable
Discrete distribution of variables Most geological measurements are samples from a continuum but if the sampling is without bias, the sample population will be a discrete model honouring the continuous distribution, and then Equation 13 to Equation 19 can be used. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 216 For a practical example, based of the approach outlined in the introduction to this chapter, please consider the uncertainty estimates used in the companion Feldbuch product available on the CD-ROM “Grant’s Geological Toolkit” (enquiries as per my website www.grantjacquier.info). However, firstly, Table 63 gives the legend of the parameters in these tables. Table 63 general notes to the discrete distribution functions Expectation (X) Variance(X) probability function cumulative probability function binomial distribution number of iterations
WARNING:
First moment of random variable X about origin 0 BASIC programs relevant to this include: n Second moment of random variable X about the Expectation (X). BASIC programs which calculate this are : n. This gives the probability of a value occuring. BASIC programs referenced include: o and p This gives the probability of any value occurring that is less than the prescribed maximum. BASIC programs referenced include: p Assumes true and false are represented by the integers 1 and 0. BASIC programs which deal with this include: o and n. The 1st (replacement) case assumes all outcomes will be available on iteration. The 2nd (non-replacement) case assumes that once an outcome is selected it is excluded from further iteration. 1 A 90% confidence interval is used in the example to determine the number of iterations to achieve that confidence interval.. POPULATION A1:C10 MUST INCLUDE ALL OUTCOMES. These BASIC programs will manufacture the permutations and combinations: q
The equivalent BASIC programs follow:
Mean, Variance, Standard Deviation; pages 121-123 of Lon Poole and Mary Borchers, Some common BASIC programs (Berkeley, California, 1979). o Binomial Distribution, pages 125-6 of ibid. p Normal Distribution, pages 128-129 of ibid. q Permutations and Combinations, pages 116-117 of ibid. n
Geocomputing Management 217 Equation 13 binomial distribution of a population parameter BASIC program
Microsoft Excel formula
discrete random variable X q
=COLUMN(A1:C10)
first value of X
=row(A1:C1)
count of population absolute minimum absolute maximum Expectation (X) n
n=COUNT(A1:A10) abs_min=0 abs_max=1 xbar=COUNTIF(A1:C10,1)/n
Variance(X) n
sigma_sq=COLUMNS(A1:C10)*xbar*(1-xbar)
Skewness(X) Kurtosis(X) inverse of X
$M1=IF(A1=1,0,1)
probability function o
$N1=BINOMDIST(COUNTIF(A1:C1,1),COLUMNS(A1:C10),xbar,F ALSE)
cumulative probability function o
$O1=BINOMDIST(COUNTIF(A1:C1,1),COLUMNS(A1:C10),xbar,T RUE)
number of iterations 1
$P1=n*LOG(1-0.9)/LOG(1-$N1)
NOTES binomial distribution
Assumes true and false are represented by the integers 1 and 0.
WARNING:
POPULATION A1:C10 MUST INCLUDE ALL OUTCOMES
Binomial distribution of probability
1
1
0.8
0.8
0.6
0.6
P(X)
P(X<=x)
Binomial distribution probability density
0.4
0.4
0.2
0.2
0
0
x
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
X
Geocomputing Management 218 Equation 14 binomial distribution of samples by a Normal model parameter BASIC program
Microsoft Excel formula
discrete random variable X q
=COLUMN(A1:C10)
first value of X
=row(A1:C1)
count of population absolute minimum absolute maximum Expectation (X) n
n=COUNT(A1:C1) abs_min=0 abs_max=1 mu=n*A$21
Variance(X) n
sigma_sq=mu*$A$20
Skewness(X) Kurtosis(X) inverse of X probability function Error! Bookmark not
A$20=1-A$21 A$21=COUNTIF(A1:A10,1)/COUNT(A1:A10)
defined.
cumulative probability function Error! Bookmark not defined.
number of iterations 1 NOTES binomial distribution
A$22=NORMDIST(COLUMN($C$1:$C$10)COLUMN(A$1:A$10)+0.5,mu,sigma_sq,TRUE) A$23=LOG(1-0.9)/(n-1/n)
Assumes true and false are represented by the integers 1 and 0.
number of iterations
1st (replacement) case assumes all outcomes will be available on iteration. The second (non-replacement) case assumes that once an outcome is selected it is excluded from further iterations.
confidence interval
1
WARNING:
A 90% confidence interval is used in the example.
POPULATION A1:C10 MUST INCLUDE ALL OUTCOMES
Geocomputing Management 219 Equation 15 discrete geometric distribution parameter BASIC program discrete random variable X q
Microsoft Excel formula =COLUMN(A1:A10)
first value of X
=INDEX(A1:A10,1,1)
count of population absolute minimum absolute maximum Expectation (X)
n=COUNT(A1:A10) abs_min=MIN(A1:A10) abs_max=MAX(A1:A10)
Variance(X)
sigma_sq=VARP(A1:A10) skewness=SKEW(A1:A10)
xbar=AVERAGE(A1:A10)
Skewness(X) Kurtosis(X) inverse of X probability function
M1=1/A1 N1=NORMDIST(A1,xbar,STDDEVP(A1:A10),FALSE) O1=NORMDIST(A1,xbar,STDDEVP(A1:A10),TRUE)
cumulative probability function number of iterations 1 NOTES WARNING:
POPULATION A1:A10 MUST INCLUDE ALL OUTCOMES
geometric distribution of probability
1
1
0.8
0.8
0.6
0.6
P(X)
P(X<=x)
geometric distribution probability density
0.4
0.4
0.2
0.2
0
0
x
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
X
Geocomputing Management 220 Equation 16 uniform distribution discrete random variable X q
parameter BASIC program
Microsoft Excel formula =COLUMN(A1:A10)
first value of X
=INDEX(A1:A10,1,1)
count of population absolute minimum absolute maximum Expectation (X)
n=COUNT(A1:A10) abs_min=MIN(A1:A10) abs_max=MAX(A1:A10) xbar=MAX(A1:A10)/2
Variance(X)
sigma_sq=VARP(A1:A10)
inverse of X probability function
M1=1/A1 =xbar
cumulative probability function
O1=COUNT(A$1:A2)*xbar
NOTES
continuous distributions
Most geological measurements are samples from a continuum but if the sampling is without bias, the sample population will be a discrete model honouring the continuous distribution and this table may be used.
Geocomputing Management 221 Equation 17 Poisson distribution of elapsed time parameter BASIC program discrete random variable X
q
Microsoft Excel formula =COLUMN(A1:A10)
first value of X
=INDEX(A1:A10,1,1)
count of population
n=COUNT(A1:A10)
absolute minimum
abs_min=MIN(A1:A10)
absolute maximum
abs_max=MAX(A1:A10)
Expectation (X)
1/lambda=1/AVERAGE(M1:M10)
Variance(X)
sigma_sq=VARP(A1:A10)
inverse of X
M1=1/A1
probability function
N1=lambda*EXP(-lambda*A1)
cumulative probability function
M2=SUM(C$1:C2)
NOTES continuous distributions Most geological measurements are samples from a continuum but if the sampling is without bias, the sample population will be a discrete model honouring the continuous distribution and this table may be used. Expectation (X) First moment of random variable X about origin 0 Variance(X) Second moment of random variable X about the Expectation (X) WARNING: POPULATION A1:A10 MUST INCLUDE ALL OUTCOMES
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 222 Equation 18 Poisson distribution of counts per second parameter BASIC program
Microsoft Excel formula
discrete random variable X q
=COLUMN(A1:A10)
first value of X
=INDEX(A1:A10,1,1)
count of population
n=COUNT(A1:A10)
absolute minimum
abs_min=MIN(A1:A10)
absolute maximum
abs_max=MAX(A1:A10)
Expectation (X)
1/lambda=1/AVERAGE(M1:M10)
Variance(X)
sigma_sq=VARP(A1:A10)
inverse of X
M1=1/A1
probability function
N1=POISSON(A1,1/lambda,FALSE)
cumulative probability function
M2=POISSON(A1,1/lambda,TRUE)
NOTES continuous distributions Most geological measurements are samples from a continuum but if the sampling is without bias, the sample population will be a discrete model honouring the continuous distribution and this table may be used. Expectation (X) First moment of random variable X about origin 0 Variance(X) Second moment of random variable X about the Expectation (X),
Geocomputing Management 223 Equation 19 Gaussian distribution parameter BASIC program
Microsoft Excel formula
discrete random variable X q
=COLUMN(A1:A10)
first value of X
=INDEX(A1:A10,1,1)
count of population
n=COUNT(A1:A10)
absolute minimum
abs_min=MIN(A1:A10)
absolute maximum
abs_max=MAX(A1:A10)
Expectation (X)
xbar=AVERAGE(A1:A10)
Variance(X)
sigma_sq=VARP(A1:A10)
inverse of X
M1=1/A1
probability function
N1=NORMDIST(A1,xbar,STDDEVP(A1:A10),FALSE)
cumulative probability function
O1=NORMDIST(A1,xbar,STDDEVP(A1:A10),TRUE)
NOTES continuous distributions Expectation (X) Variance(X) WARNING:
Most geological measurements are samples from a continuum but if the sampling is without bias, the sample population will be a discrete model honouring the continuous distribution and this table may be used. First moment of random variable X about origin 0 Second moment of random variable X about the Expectation (X) POPULATION A1:A10 MUST INCLUDE ALL OUTCOMES
Gaussian distribution of probability
1
1
0.8
0.8
0.6
0.6
P(X)
P(X<=x)
Gaussian distribution probability density
0.4
0.4
0.2
0.2
0
0
x
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
X
Geocomputing Management 224
Continuous distributions of variables Equation 20 uniform distribution of a continuous variable Selective, truncated, biased or incomplete sampling samples of continuous random variable X
=COLUMN(A1:A10)
first sample value of X
=INDEX(A1:A10,1,1)
count of samples
=COUNT(A1:A10)
arithmetic mean of samples
xbar=AVERAGE(A1:A10)
standard deviation of samples
s=STDDEV(A1:A10)
Continuous distribution parameters/estimates absolute minimum value
abs_min=
absolute maximum value
abs_max=
Expectation (X)
mu=MAX(A1:A10)/2
Variance(X)
sigma_sq=0
inverse of X
M1=1/A1
probability density function
N1=mu
cumulative probability function
O1=mu*A1-abs_minimum
predicted value of X
P1=RANDBETWEEN(abs_min,abs_max)
sampling If you suspect that your sampling is unbiased and produces a complete, but discrete representation of the continuous distribution, then please use a discrete distribution. Expectation (X) First moment of random variable X about origin 0 Variance(X) Second moment of random variable X about the mean/average
Geocomputing Management 225 Equation 21 Poisson distribution of a continuous variable Selective, truncated, biased or incomplete sampling samples of continuous random variable X =COLUMN(A1:A10) first sample value of X
=INDEX(A1:A10,1,1)
count of samples
=COUNT(A1:A10)
arithmetic mean of samples
xbar=AVERAGE(A1:A10)
standard deviation of samples
s=STDDEV(A1:A10)
Continuous distribution parameters/estimates absolute minimum value
abs_min=0
absolute maximum value
abs_min=infinity
Expectation (X)
1/lambda=1/AVERAGE(M1:M10)
Variance(X)
sigma_sq=
inverse of X
M1=1/A1
probability density function
N1=lambda*EXP(-lambda*A1)
cumulative probability function
O1=1-EXP(-lambda*A1)
predicted value of X sampling If you suspect that your sampling is unbiased and produces a complete, but discrete representation of the continuous distribution, then please use a discrete distribution. Expectation (X) First moment of random variable X about origin 0 Variance(X) Second moment of random variable X about the mean/average lambda This is an approximation only
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 226 Equation 22 Standard Normal distribution of a continuous variable Selective, truncated, biased or incomplete sampling samples of continuous random variable X =COLUMN(A1:A10) first sample value of X
=INDEX(A1:A10,1,1)
count of samples
n=COUNT(A1:A10)
arithmetic mean of samples
xbar=AVERAGE(A1:A10)
standard deviation of samples
s=STDDEV(A1:A10)
Difference of sample mean and distribution mean (90% confidence) Continuous distribution parameters/estimates absolute minimum value
delta=CONFIDENCE(1-0.9,1,n)
abs_min=NORMSINV(0)
absolute maximum value
abs_max=NORMSINV(1)
Expectation (X)
mu=0
Variance(X)
sigma_sq=1
inverse of X
M1=1/A1
probability density function
N1=NORMSDIST(A1)
cumulative probability function
O1=NORMDIST(A1,0,1,TRUE)
predicted value of X
P1=NORMSINV(O1)
sampling If you suspect that your sampling is unbiased and produces a complete, but discrete representation of the continuous distribution, then please use a discrete distribution. Expectation (X) First moment of random variable X about origin 0 Variance(X) Second moment of random variable X about the mean/average delta For demonstration purposes 90% confidence interval is assumed.
Geocomputing Management 227 Equation 23 Normal distribution of a continuous variable Selective, truncated, biased or incomplete sampling samples of continuous random =COLUMN(A1:A10) variable X first sample value of X =INDEX(A1:A10,1,1) count of samples
n=COUNT(A1:A10)
arithmetic mean of samples
xbar=AVERAGE(A1:A10)
standard deviation of samples
s=STDDEV(A1:A10)
Difference of sample mean and delta=CONFIDENCE(1-0.9,STDDEVP(A1:A10),n) distribution mean (90% confidence) Continuous distribution parameters/estimates absolute minimum value abs_min=NORMINV(0,mu,STDDEVP(A1:A10)) absolute maximum value
abs_max=NORMINV(1,mu,STDDEVP(A1:A10))
Expectation (X)
mu=RANDBETWEEN("xbar-delta","xbar+delta")
Variance(X)
sigma_sq=
inverse of X
M1=1/A1
probability density function
N1=NORMDIST(A1,mu,STDDEVP(A1:A10),FALSE)
cumulative probability function
O1=NORMDIST(A1,mu,STDDEVP(A1:A10),TRUE)
predicted value of X
P1=NORMINV(O1,mu,STDDEVP(A1:A10))
sampling If you suspect that your sampling is unbiased and produces a complete, but discrete representation of the continuous distribution, then please use a discrete distribution. Expectation (X) First moment of random variable X about origin 0. Variance(X) Second moment of random variable X about the mean/average. delta For demonstration purposes 90% confidence interval is assumed.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 228
The analysis & processing phase The analysis and processing development phase of an ore system corresponds to the preparation of results in exploration. Statistics play a great part in this and the spreadsheet at Equation 24 suggests the spectrum of statistical techniques, which may come into use. One of the really exciting aspects for mathematicians working in earth science is the great range of probability distributions that can be found. Some of these are shown in Equation 13 to Equation 23 in the previous section ‘Statistics for field data’, but for ease of use they have been divided into those distributions that cover only discontinuous or integer values and those continuous distributions, which can have any real number. Equation 24 reference to the continuum of statistics http://www.grantjacquier.info/stud.xls#probability Whatever formulas you do reduce the data with just keep in mind the accuracy and precision of your measurements. An interesting toungue-in-cheek quote appeared in Position magazine on measuring Mount Everest r, reminds me that whatever the answer returned by an algorithm you should modify the answer to account for the precision. In the case of Figure 26 perhaps an estimate of 8840 ± 10 metres would have conveyed better meaning, and the conclusion that there was no change in the measured height of Mount Everest would have been more responsible.
Chinese authorities say Mount Everest is now 3.7 metres shorter than it was in 1975, the last time they measured it. The director general of the Chinese State Bureau of Surveying and Mapping, Chen Bangzhu, says the height at the summit is 8844.43 metres, with a precision of 10.21 metres. Chinese surveyors, armed with GPS and radar measuring equipment, spent 40 minutes at the summit to take the measurements. Figure 26 the height of Mount Everest
r
'News', Position no. 21 (2006), p. 29.
Geocomputing Management 229 A problem that often confronts me when dealing with large data sets is whether to rely on individual scientists to do calculations on demand or batch process a collection of data or set a crawler loose to process it at several convenient times. The situation where a batch process may be used is:
the job takes less than an hour and can be run before work the job can be scheduled almost every database file is to be affected by daily changes the job does not overload the computer being used by scientists
If these conditions are not met, and you cannot rely on your colleagues to do their calculations as required, you may consider using a crawler script to do the work. I consider that there are two types of crawler scripts. The first, which I call the Fuzzy Logic model, is where the data may be changed by scientists during the day and you have to consider recalculation of all elements every time and this is effectively the replacement model from statistics. By elements I am using as a general term, which could be wells, prospects, sites, or pumps just depending on your situation. In the Fuzzy Logic situation the full list of elements is used each time but whether any item on that list is used is determined by applying Fuzzy Logic. That is a certain fraction usually less than 0.1 is nominated, which in effect says that only 10% of the elements examined will be processed. The second type of crawler script, which I call the Bayesian, is where the scientists probably won’t change the data during the day and there is no point recalculating an element once it has been calculated. Equation 25 iterations required for a Bayesian crawler log(1 Pc) i n 1 log n
n : the number of elements in the collection i : the number of iterations required to preserve the specified confidence Pc C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 230 The key factor for the both types of crawler, to get the database as a whole up to the quality needed, is just how many times should the script be run? Well, I try to get my clients to express their expectation of quality as a confidence that matches the confidence of the rest of the data. So you ask, “how good in percentage terms is your data?”, and then convert that into a decimal fraction and this gives you the confidence of the data set and there is no point in specifying your crawler to go beyond that because the data is already limited by that confidence. As you would expect because there is replacement in the Fuzzy Logic model, you can see by comparing Equation 25 and Equation 26 that there are slight differences between the numbers of iterations required for the same population. Equation 26 iterations required for a Fuzzy Logic crawler
log(1 Pc) i n log P f n : the number of elements in the collection i : the number of iterations required to preserve the specified confidence Pc P’f : the nominal Fuzzy Logic chance of NOT processing an element
Analysis & processing for a Ballarat ore system The analysis and processing stage is the guts of what geologists do but with geological computing of any sort including remote sensing getting to the truth is not straightforward or in most cases possible. In Table 64 the processing or analysis stage is one among others, but it is also important to note that how far distant the ANSWER returned to the client is from the TRUTH. A computer geologist should never confuse their advice with the truth. If your client wants to believe an answer then they should go to church, because you can only ever give an estimate. Table 64 remote sensing and geological computing stages remote sensing1 problem target
geological computing The Earth with the TRUTH geological model mathematical model
Geocomputing Management 231 sensor analysis report
input processing output The client with the ANSWER
1
Geological model - facts In deciding what to use for a geological model probably the easiest is to select a stereotype from somewhere else that you can apply in the area of interest. I use the word stereotype in preference to archetype because an archetype is the classic example, which is fully understood, whereas the stereotype is an over-generalised model. Consistent with the warning in the previous section against believing in geology, in the 21st century when we have so little geological knowledge, we can expect more stereotypes than archetypes.
orogenic gold mineralisation The target ore system according to Polito et. al. (2001), based on a stereotypical orogenic gold mineralisation at the Junction Deposit, Western Australia is shown in Table 65. Table 65 check list for an ore system MINERALISATION TYPE: orogenic gold mineralisation stereotype: eg Junction Deposit, Western Australia 1 part source
component e.g. intra-crustal basin fluid in Black Flag Grp shales
transport
e.g. fault
cap
e.g. hydraulic – hydrothermal waters (70-440 MPa)
trap
e.g. fluid-wall rock interaction with iron-rich host (Junction Dolerite)
references 1 POLITO, P. A., BONE, Y., CLARKE, J. D. A. and MERNAGH, T. P. 2001 Compositional zoning of fluid inclusions in the Archaean Junction gold deposit, Western Australia: a process of fluid-wall-rock interaction? Australian Journal of Earth Sciences, 48, 833-855. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 232
Geological model - fiction Let us consider a version of orogenic gold mineralization for a deposit type not previously found at Ballarat, Victoria, but based on an ore system after Polito et. al. (2001) where:
source: intra-crustal basin fluid in Ordovician turbodites transport: mapped fault cap: hydrothermal waters (< 500m true thickness from Gellibrand Marl) trap: fluid-wall rock interaction with iron-rich host (Mt Bute Adamellite). See Table 66 for petrological sequence
Table 66 Feldspar and quartz mineralogy of some igneous rocks OROGENIC GOLD MINERALISATION unknown Ballarat deposits, Victoria (after Polito et. Al. 2001) K-feldspar rich less quartz syenite monzonite more quartz adamellite
plagioclase rich diorite
Mathematical model Assumptions dip is 5-10 degrees* use a geographic information system algorithm Find intersections of faults and Mount Bute Adamellite.Select those intersections within 50 km (500m true thickness*) of the Gellibrand Marl.
Select the input data Start the geographical information system with a new data base (Project) and the first fons of the same scale and projection (View). The load a single layer (theme) to the first fons. The commands to do this in ArcView are shown in Equation 27. Equation 27 - selecting input data in ESRI ArcView c:\ESRI\Av_gis30\Arcview\Bin32\Arcview File | New | Project
Geocomputing Management 233 View | Add Theme
Processing
Intersections of faults and host rock Start ArcView ball_geology | Theme | Properties | Tools FORMNAME = “Mount Bute Adamellite” View | Save as shapefile | j2002077.shp ball_structure | Theme | Properties | Tools structure_sub-type = “faults” Ball_structure | Theme | Select by theme | j2002077.shp View | Save as shapefile | j2002078.shp
Select fault intersections within hydrothermal influence Start ArcView ball_geology | Theme | Properties | Tools FORMNAME = “Gellibrand Marl” Theme | Select by buffer
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 234
Corporate information & data sharing phase The corporate information and data sharing development phase of an ore system corresponds to the project review in exploration. This is where ore systems must be compared to allocate further funding. This phase often requires the application of standards to project data and the back loading of that data into a database that is common with other projects. Even if you have the smallest consultancy, you still need to send around e-mails, keep track of client requests so the minimalist system is a series of Folders in Microsft Outlook and I sue those shown in Table 67. Wit this as the basis, you should consider the following sections and see if you need more: 1. 2. 3. 4. 5.
The Head Office syndrome Some theory of database design A good bet: the Extranet The Ballarat demonstration The future
Geocomputing Management 235 Table 67 list of the working e-mail folders 1
CHECK WORKING FOLDERS The General folder should contain the following folders 2 Calendar item Contacts folder Change of Address Family and friends SGiC vendors other: Correspondence 2 Drafts Inbox 1 Journal Lists Pending Sent Items thematic folders: e.g. Helen, FIELDWOR, Job Network the Archive folder (e.g. Archive3.pst) may contain the following folders 1 Calendar Journal Sent Items other:
NOTES 1 Configuring these is given in Table 116 check list for adding e-mail accounts and signatures 2 For other Report folders names see Table 71 check list of archives against report stream
The Head Office syndrome Done properly, the introduction of data for a new target or problem into the corporate data set, will build up the earth model, and all projects will benefit by the expanded scope of the data set. However, as this work is a corporate responsibility, clerks with predominantly commercial computing experience will usually carry it
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 236 out, and so the issues from Yacopetti and Mundell s that the scientist should plan to control are:
Capture of original observations and measurements to reduce error at the point of origin Discovery and access to the captured data Differentiation of original data from derivative data Identification of metadata (or data about the data) Data interoperability— providing the data in variety of standard formats Delivery of select data sets to required client systems Aggregation and abstraction of data and delivery in desired formats Internal data quality alerts and measures.
The golden rule is that once data is in any type of electronic format it is quite easy to map it to another. The structure of a new database can be daunting but there are some rough translations as shown in Table 68. Table 68 equivalent data structures. Codd database relation tuple attribute 1
SQL database instance schema table row column
FORTRAN program run report file record field
MS Excel template workbook collection range row column
GIS project algorithm set aoi1 layer
Geolog site project well set frame log
aoi: area of interest
Some theory of database design If you do have some time [or permission] for planning how your data will be loaded up, give some thought to the geological relationships between the data. For instance the scientific significance of nominating relationship cardinality in a database design and the impact on display of the associated measurements is shown in Table 69.
s
Yacopetti and Mundell, 'Improving the quality of geoscientific information.'
Geocomputing Management 237 Table 69 the alignment of database design and presentation.
geological
relationship cardinality 1 many - many
mathematical significance non-linear
many mandatory linear optional - one chaotic biological optional-many random 1 defined on page 106 of McFadden and Hoffer (1991)t
e.g.
best display method cumulative frequency histogram
to
cross-plot
A good bet: the Extranet As we are on the move in the field we will always have the problem of communicating with the head office, clients or supervisors. I suppose originally it started with the post and then later in the more remote cases there really was a postal drop from an aeroplane. In the early eighties a colleague thought the greatest invention was the fax machine because you could send diagrams not just text, you could do away with your answering service, at that time a receptionist working at secretarial bureau, and you didn’t have to get up in the middle of the night to talk to colleagues in the United States, just leave the machine on. I can understand the feelings of that fax lover, because I feel similarly about the World Wide Web (www) and hypertext markup language (HTML) files. Having a website means I don’t:
Spend a day a month updating various copies of user manuals and tip-sheets for my client. Leave the particular folder at my office when I need it with a client. Have a pile of enquires requiring short but detailed answers when I get back from the field. Have two or three lists of websites which I have to update in multiple places every time a client or supplier changes their address or location of technical data on the Internet. Forget where all the files for a particular project are, especially when I am using different software and the files are in several different folders or even on different systems.
McFadden and Hoffer, Data base management. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM t
Geocomputing Management 238 From the client’s perspective I liked these things from the Eagle Resource Advisory web-site (Jacquier 2011u):
easily read document format (Adobe Portable Document format); a mixture of text and good figures; a modern but simple design that doesn’t detract from the content; uses companies in the same state as the business so that any misuse can be dealt within the local jurisdiction [quickly]; reports are indexed, and in a common format giving a single data set; the indexing method quickly shows the scope of the material, in this case by a single image of keywords (date, company name, exchange company code), the size indicating the occurrence in the reports; the material is stored off-site from the Eagle Research Advisory office adding to the security as an archive.
Originally, I used my client’s internal web site or intranet, then I began to use HTML files with Javascript forms, on my laptop to catalogue the various files in a project, but when Telstra Bigpond set up the universal number for home users, where you can ring the same number (0198 308 888) right across Australia, I moved a lot of the non-confidential material on the Telstra Bigpond site to make an extranet, that I can access it from my own office, a client office, or a motel room, and my clients can make use of, if I am not around. I have considered setting up my own web server on Linux especially as I could also run on the same server, the geographical information system (GIS) and image processing software, GRASS, which is a shareware product, but this would require a lot of my time to set it up and do the system administration. I also found, when I tried to run a computer as a fax machine that running a computer 24 hours in the home is a little bit impractical, with the machine getting hot, the disk drive and fans wearing out, and just the inconvenience of a big box near the phone connection. It was much easier to use a modern stand-alone, disk-less fax machine. u
Grant L Jacquier, 'Eagle Research Advisory www.eagleres.com.au', The Great Australian Byte no. 4 (2011), pp. 17-18.
Geocomputing Management 239
The Ballarat demonstration On the 1st disk of the Ballarat GIS Data, there is the directory exploration_summary. This folder has a series of reports, each with a serial number for various prospects. They are in Adobe PDF format, so you can make an HTML file to index and describe these, as your own corporate database. The expectation is that you add your new prospects at a later time, maintaining the same style and file format. There are 289 files in that directory, but you could use variations of these examples to make indexes in HTML or KML file suitable for an extranet:
Making a catalogue of document files Make an asset catalogue for the natural environment
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 240
The presentation & publishing phase I feel the presentation and mapping component is the most important component of all for a scientist. Very rarely does a scientist work without patronage whether it is shareholders, the Australian Research Council or a posse of concerned citizens. It doesn’t take much imagination to exhaust your own money and this is where you can generate further funds by presenting your work well and encouraging people to assist you or alternatively publicising your findings and getting society to change v. For me it is what I feel I do the worst but anyhow I will persevere with some suggestions in Table 70. The discussion of how this fits with the Ballarat data model is given in the section following that table.
v
Grant L Jacquier, 'Geological Monuments in South Australia DVD', The Great Australian Byte no. 1 (2012), pp. 5-9.
Geocomputing Management 241
Table 70 browsing software for presenting data date:
Computer name:
0
CATEGORY Computer program 1 SCIENCE SPECIFIC BROWSERS (remove on disposal) Required for batch processing Y Table 135 Thomson Endote, customisation Oxford English Dictionary Table 136 GS Surfer, customisation Y Table 136 GS Scripter, customisation ? Table 136 GS MapViewer libraries, customisation Table 136 GS MapViewer, customisation A+ French 2 ALTERNATIVE BROWSERS Was used for batch processing OpenWave Simulator ( WML browser for phone simulation) Y img2tif.pif or IMG2TIF.PIF 1 Geomatica Freeview (used for browsing Imagine img format) Blaxxun Contact (used for 3D models) 3 GENERAL BROWSERS (leave these as installed) Is used for batch processing and needs to be present Microsoft Internet Explorer Google Earth Y Table 131 office software customisation Apple iTunes 4 TEMPLATES (rescue these to C:\DATA\C_IN_G\templates) Is used for batch processing and needs to be present at usual path program template file Y Thompson EndNote see Table 135 Click’N Design 3D C-n_g.dtp Y Golden Software suite see Table 136 Y Microsoft / WordPerfect Office see Table 131 LEGEND Y : either is being used, or has beend used for batch processing ? : these libraries may be available with any Golden Software Scripter installation NOTES 1 The img2tif.pif was previously found on the Luminiere system at: C:\PROGRAMS\GRASS\translat\img2tif.pif
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
version
tick
Geocomputing Management 242
Presentation & map for a Ballarat ore system The report on the prospects is often portrayed as a prospect map. In information technology jargon a map is a Decision Support System. The work of Case et al (2001) w; and Feeney and Williamson (2000) x suggest that any decision support system must have three components in the layout of knowledge data, understanding data and information data.
prospects (KNOWLEDGE DATA ie interpretation) Roads (UNDERSTANDING DATA ie situation) DTM (INFORMATION DATA ie location)
CASE, M. P., GORAN, W. D., GUNTHER, T. A., HOLLAND, J. P., JOHNSTON, D. M., LESSARD, G. and SCHMIDT, W. J. 2001 Decision support capabilities for future technology requirements. Technical Report ERDC TR-01-2; U.S. Army, Corps of Engineers, CERL, Champaign, Illinois .x FEENEY, M.-E. and WILLIAMSON, I. P. 2000 Researching frameworks for evolving spatial data infrastructure. Proceedings of The 12th annual colloquium of the spatial information research centre,University of Otago, Dunedin, New Zealand. x FEENEY, M.-E. and WILLIAMSON, I. P. 2000 Researching frameworks for evolving spatial data infrastructure. Proceedings of The 12th annual colloquium of the spatial information research centre,University of Otago, Dunedin, New Zealand. w
Geocomputing Management 243
The archive & reporting phase Reporting of your work to others and then wrapping it up into packages for storage is a special part of geological computing. This reflects general practice where Abercrombie (1989 y) quotes “65 cents of every dollar expended on record keeping and filing is wasted” and prescribes that you: 1. Choose what to store (in my sub-section “The layout of directories”) 2. How long to store it 3. What format to store it in (see my subsection “Selecting a data exchange file format”) 4. Where to store it (see my subsection “hardware considerations). 5. ensure your vital records are protected (see the sub-section “Running your archive and reporting system”) As well as the sections mentioned against Abercrombie’s criteria, in Table 71 I give how I send out my reports, by e-mail, and where I store the replies in correspondence files (Microsoft Outlook uses a file suffixed .pst) and the report document files in the adjacent folder. Plus these authors found in the bibliography have further thoughts on archiving and reporting:
Anonymous (1996) Anonymous (1999c) Bolt (1992) Heymink (1988) D’Angelo & Troy (2000)
Johnson (2012z) points out that “access to historical data which predates the digital age remains important”. In other professions such as law or accountancy there are limitations to the time that you have to keep records. However, in geology, today’s problem or commodity can become of no interest the next day. In computing y
Abercrombie, 'Text retreival for mineral exploration companies or find what you file.'
z
Johnson, 'The Role of Information Professionals in Geoscience Data Management: A Western Australian Perspective'. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 244 terms geological data has high latency in that it is not used much but long currency in that it is still relevant for many tens of years. The way to keep track of all the different projects that have been put away, even if it is just until the next drilling season, is to summarise the basic data into reports. These reports are more easily digested and can be kept in mind. Some of the types of reports that are treated in this grimoire are: time and expense allocation, prospect report, thesis, footing or foundation report. That is not an extensive list and in the table on my web-siteaa I show that each type of geologist has special standard reports. As the data will be left for a time without use, how and what the detail is, become quite critical. Facts to use in this kind of work can be found in the check lists:
Table 27 secondary storage Table 28 Current backup policy Table 62 electronic file indexing schemes for geology Table 77 abbreviations and conversion of disk capacity Table 74 service levels versus document management Table 75 backup system versus archive system Table 76 emergency recovery plan Table 82 check list of file documentation Table 98 alphabetical list of fields from EndNote with equivalent start tag from the EndNote proprietary XML Table 99 check list for making a catalogue of files Table 100 expenses incurred by geologists Table 102 check list for calculating project hours Table 61 conversion of key words into project codes Table 103 convert project code into expense type Table 104 summary table for work time allocation Table 114 the Computers in Geology recovery plan Table 118 checklist for setting up an intranet Table 132 checklist for recovering critical data from the default folders
Doing the report well, from a publishing perspective, is not always straight forward. In 2010, Primary Industries South Australia released the DVD ‘Geological Monuments of SA’ and it had a few
Table 1 published reports with contributions by different mineral surveying occupations found on http://www.grantjacquier.info/biography.html aa
Geocomputing Management 245 quirks with accessing Adobe PDF files which I investigated bb. Abercrombie (1989a) explains there are three basic types of software available: turnkey records systems, information management packages, and free text retrieval packages. The examples she gives are mainframe systems for corporations and government but she does give the principle uses as: 1. To track file movements, for example by the use of a barcode system 2. For the production of printed file indexes which may be used to locate files in small records systems 3. For Online searching, to locate files meeting one or several criteria 4. or a combination of all of these. She also gives us a shopping list of features a. Document and file tracking ability b. Free text searching capabilities, which should ideally be used with a file classification system such as keyword. c. A correspondence system which permits the unique identification of each item, as well as each file. d. A bring up system of for files which will require further action at a later date. e. The facility for machine management of records retention and disposal schedule. In 1989, Abercrombie cautioned that the turnkey records management systems were the most inflexible of the three categories of software, but by 2011 Andrew cc emphasised that software is there to get over those “tiresome tasks” like formatting references, and gave the features that she liked about Thompson EndNote as:
Manages [bibliographic] reference databases Input is directly from [online] databases or typed in
Grant L Jacquier, 'Review of the implementation of the 'Geological Monuments in South Australia' DVD', The Great Australian Byte no. 3 (2010), pp. 6-11. cc Anita Andrew, 'From the AJES Hon Editor's Desk', The Australian Geologist no. 158 (2011), p. 40. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM bb
Geocomputing Management 246
Used in conjunction with a word processor including Microsoft Word, open office and Macintosh Pages. However it is a benefit if it works best with Microsoft Word. Should use styles and templates for automatic reformatting of references, preferably with a web library of those styles (EndNote has styles for over 4000 journals) Example Documents and tutorials which you can download. Trial copies or site licences where you can introduce colleagues to the software.
I have included quite a few exercises in ‘Chapter 4 – METHODS: improving your capability’ which deal with practical aspects of archiving and reporting. Some of them use Thompson EndNote, the very software recommended by Andrew: 1. 2. 3. 4. 5. 6.
XML provides versatility in data handling The future: dedicated catalogue applications Make an asset catalogue for the built environment Make an asset catalogue for the natural environment Use photographs as the background Share the folders of your digital photographs on your intranet 7. Showing thumbnails with Microsoft Internet Explorer 8. Mount the photographs in Google Earth
Geocomputing Management 247
Table 71 check list of archives against report stream REPORTING Report stream (e-mail address); account name, name, company Parkside ADSL ( [email protected] ); gljacquier, ADSL account; Parkside SA Education SG ( [email protected] ); sgic.gsaustl, Education Specialist Group, Geological Society of Australia Grant Jacquier ( [email protected] ); grant.jacquier, Grant JACQUIER, Corinda QLD Helen Rice ([email protected] ); helen.rice, Helen RICE, Parkside SA CompsInGeology ( [email protected] ); compsingeology, Computers in Geology, Corind QLD Grant Jacquier , [email protected] ; grantjacquier, post-master, Corinda QLD ARCHIVE (file directory) FILE (folder title)
tick
GENERAL (C:\DATA\Profiles\default\Outlook\.) correspo.pst (General)
X
X
-
X
Y
X
archive.pst (1999/12-2006/3) Sent Items only
Y
Y
-
Y
-
Y
archive1.pst (2006/3-2009/9) Sent Items only
Y
Y
-
Y
-
-
archive2.pst (2009/9-12/2015) Sent Items only
Y
Y
-
Y
-
Y
archive3.pst (1/2016-current) Sent items, Journal only
Y
Y
X
Y
Y
X
agia\Outlook.pst (AGIA)
-
Y
-
Y
-
-
AMS\Affinity.pst (Affinity)
-
Y
-
-
-
-
GMHCruze\GMHCruze.pst (GMHCruze)
-
Y
-
-
-
-
IMC\Personal Folders\*.pst (IMC)
-
Y
-
-
-
-
morgstan\shares.pst (Shares)
-
-
Y
-
-
-
pbank\outlook.pst (Peoplebank)
-
Y
-
-
-
-
pdgm\pdgm.pst (Paradigm)
-
-
Y
-
-
-
regency\regency233.pst (Regency233)
-
-
-
Y
-
-
SGIC\CORRESP\…\Personal Folders(1).pst (GSA)
-
-
-
Y
X
-
unimelb\Personal Folders.pst (U. Of Melb)
-
-
-
Y
-
-
workpac\Personal Folders.pst (Workpac)
-
Y
-
-
-
-
FAMILY\bday.pst (Birthdays)
-
-
-
Y
-
-
FAMILY\Family.pst (FAMILY)
-
-
-
Y
-
-
mrspots.pst (to 1999/11)
REPORTS (C:\DATA\REPORTS\.)
SPECIAL (C:\DATA\.)
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 248 REPORTING Report stream (e-mail address); account name, name, company Parkside ADSL ( [email protected] ); gljacquier, ADSL account; Parkside SA Education SG ( [email protected] ); sgic.gsaustl, Education Specialist Group, Geological Society of Australia Grant Jacquier ( [email protected] ); grant.jacquier, Grant JACQUIER, Corinda QLD Helen Rice ([email protected] ); helen.rice, Helen RICE, Parkside SA CompsInGeology ( [email protected] ); compsingeology, Computers in Geology, Corind QLD Grant Jacquier , [email protected] ; grantjacquier, post-master, Corinda QLD ARCHIVE (file directory) FILE (folder title) HRICE\Outlook Express\Outlook.pst (Helen)
tick -
-
X
-
-
LEGEND X : default file for this data Y : you may find this data present in this file - : Usually you will not find data of this type archived in this file NOTES 1 To see current archive settings use the menu item: File | Options | Advanced | Auto Archive Settings…
-
Mapping the layout of your directories to projects Abercrombie (1989a) states that “if meaningful terms which accurately reflect the contents of the file are used to create the file title, and these terms are part of a a controlled vocabulary, then retrieval will be relatively simple”. She gives the title example “ADMINISTRATION – INSTRUCTION – ANNUAL LEAVE – ENTITLEMENTS - 1980”, which immediatlely makes clear that her concept of “file title” is not the document title nor the computer file name, but rather an ordered list of words, that you would find in the “keywords” field of a Microsoft Word file. In my case if keywords, such as those in Table 61 have not been allocated to a research project for time allocation, I use the chart of directories in Table 72 as default allocations to projects for Computers in Geology. Files which are just associated by the batch file but not given any keywords or journalled, for example all Golden Software files, are left out of the calculations for time allocation. The sections from Chapers 4 and Chapter 5 which relate to this activity are: 1. 2. 3. 4. 5.
Using a Microsoft Batch file for project management Making an HTML file to run a batch file Export an HTML catalogue direct from Thomson EndNote Making a catalogue of document files The use of Thompson EndNote in preference to Microsoft Excel as a catch-all document database 6. Methods of making a catalogue file 7. Using Microsoft Excel for editing of the catalogue 8. Time and expense allocation Table 72 is referenced by Table 102, a check list for calculating project hours, a process which principally relies on the allocation of keywords, such as those in Table 61. Table 72 also shows other ways of collecting documents into projects, such as a formal batch file in Equation 97 or using the query facility in Thomson EndNote suggested by the check list of Table 99.
a
Abercrombie, 'Text retreival for mineral exploration companies or find what you file.'
Geocomputing Management 250 Table 72 allocating documents to research projects start: 1st July
end: 30th June
20
20
Excel file:
End row:
TECHNIQUE IN ORDER OF EFFECTIVENESS components 1 KEYWORDS PLACED IN CATEGORY AT TIME OF WORK 1 Table 61 has samples of keywords for the files 2 ALTER CATEGORY OF JOURNAL EXTRACTS BY DIRECTORY 1 Ignore or Remove these directories C:\Program Files\... C:\Program Files (x86)\Microsoft Office\... C:\TEMP\... C:\Users… F:\Xdescriptions\ file path element in subject column category keyword \ADMIN\ administration \C_IN_G\LETTERS\ administration \DATA\PICTURES\ private \DATA\Profiles\... administration \DATA\REPORTS\* administration \DATA\REPORTS\AGIA\ AGIA \DATA\REPORTS\AMS\ Affinity IT Recruitment \DATA\REPORTS\GSA\ GSA \DATA\REPORTS\regency\ The Regency Lodge \DATA\REPORTS\SGIC\ GSA-SGiC \C_IN_G\BILBY\ Project Bilby \C_IN_G\extranet\. Project Fruitbat \C_IN_G\extranet\develop_files\. Project Kookaburra \FAMILY\ Project Quoll \C_IN_G\goanna\ Project Goanna \C_IN_G\GTOOLKIT\ Project Kookaburra \C_IN_G\HOME\. Project Fruitbat \HRICE\GREECE\ Project Kookaburra \HRICE\ private \KITBITS\ Project Kookaburra \NUMBAT\. Project Numbat \perentie\ Project Perentie \quoll\ Project Quoll \templates\ general \unimelb\ Project Numbat \WOMBAT\ Project Wombat 3 EXPLICIT ASSOCIATION IN A CATALOGUE
tick
use
Geocomputing Management 251 start: 1st July
end: 30th June
20
20
Excel file:
End row:
TECHNIQUE IN ORDER OF EFFECTIVENESS components For example poster.bat in Equation 97 4 IMPLICIT ASSOCIATION IN A CATALOGUE For example Thompson EndNote in Table 99 EXAMPLE REPORTS 1 Time and Expense allocation report as per check list in Table 102
tick
Managing your archive and reporting system An archiving system is a result of your data management thoughts (or policy if you have employees), but as it is not directly involved with current projects and therefore current cash stream, it is based around your thoughts on backing up your computer, which you can charge as operating cost against your current income. Again if you have employees, partners or colleagues you may call this the IT disaster recovery plan and have it written down and stuck on the cupboard door where you keep the backup disks, such as Table 73. Table 73 nomogram for USB stick and DVD based archive/backup system with a fortnightly period media USB A USB B RW-DVD USB D USB E RW-DVD Archive
02 04 06 08 10 12 1
Number of the week (Gregorian calendar) 14 26 38 50 16 28 40 52 18 30 42 20 32 44 22 34 46 24 36 48 2 3 4
In principle an archive system differs from a backup system. The objective of the backup system is to keep your computer running (or maintaining the service level agreement if you have outsourced your information technology support), whereas the archive system is about preserving the information. Nevertheless, Abercrombie (1989 b) b
Ibid. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 252 links the two systems with her insistence of “Ensure your vital records are protected”. To describe the planning to implementation I have broken the narrative into three sections: policy, system and hardware.
Policy for archive and reporting Abercrombie’s directive is shown in diagrammatically in Table 74 as a two-tier hierarchy. I have had several integrated archive and backup systems, each one taking advantage of improvements in the basic computing system. The one I have used from 2002 is based on the template illustrated by Table 74, plus Table 75 and Table 76.
Geocomputing Management 253 Table 74 policy in terms of service levels for backup systems versus document management for archive systems POLICY service level agreement I can lose a days work on a document I never work on a document on more than one day a week. I can do without a computer for a week or so. I will leave important copies of e-mail in Microsoft Outlook (c:/windows/profiles) I will leave important templates from Microsoft Office in the Windows directory (c:/windows/application data). I don’t care about re-loading my software as this gives me a chance to fine tune the configuration further I keep all original software disks in my office.
document management policy All client reports will have a “j” number as the file name.1 All AGIA letters will have an “a” number as the file name and be stored in the subdirectory of /data/reports/agia/letters. 1 All SGiC letters will have an “s” number as the file name and be stored in the subdirectory of /data/reports/sgic/letters. 1 All Computers in Geology business will have a “c” number as the file name and be stored in the subdirectory of /data/c_in_g/letters. 1 All “j” number files for a period will be in one and one only client directory. For financial records I only need the latest revisions, so they have constant file names like shares.xls, backreg.xls, bal0304.xls etc and are stored in the c:/data/admin directory. All document files will be kept indefinitely except taxation and computer maintenance records. Until 2001, “j” files were catalogued in monthly reports, stored in the client directories. Since 2001 the “j” files have been catalogued in EndNote. SYSTEM as per Table 75 backup and restore system archival and retrieval system HARDWARE as per Table 76 disaster recovery plan NOTES 1 The “letter” file names are composed of a letter prefix followed by a four-digit year then a folio number and then the suffix denoting the software used on the file for example j2004003.doc is the third client report of 2004, composed in Microsoft Word format. Each version of a report has a unique file name to make snap shots of the work.
Template for the archive and reporting I think the key aspect in the two policies in Table 75 is that reports with versions are handled by issuing a new name, allowing the previously numbered file to be a snapshot suitable for archiving. Everything else is treated as the latest available version and is supported by the backup system. When in 2012, when I took up salaried work, I moved my system onto the less frequent plan of Table 73 and interspersed rewritable USB drives. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 254
Table 75 backup system versus archive system POLICY as per Table 74 document management policy SYSTEM BACKUP / RESTORE SYSTEM ARCHIVE / RETRIEVE SYSTEM i. Store all working data in /data i. Put archive files in a separate directory tree directory tree (/archive1 , archive2 etc), max 640 Megabytes per ii. Every one to 4 weeks, depending on directory tree. how much writing I have been doing, write to CD ROM the directories ii. Every time I open a new box of CDc:/data/ c:/windows/profiles, and ROMS I spin off copies of each of the c:/windows/application data/.1 archive directories.1, 2 iii. When these three directories start to iii. Primary retrieval is from the read only get near 640 Megabytes in total, move directories on the c: drive. older not-used data to a new archive iv. Secondary retrieval or transporting directory tree. documents to a client’s office is by iv. Restoring is by reading the CD-ROM getting the CD-ROM and just reading previous to the problem it in the drive. DO NOT USE multiple write CDs as this needs special software.3 HARDWARE as per Table 76 disaster recovery plan 1 The CD-ROMs are written with Adaptec Easy CD Writer. 2 By using different brands and packs of CDs you are reducing the opportunity of being inconvenienced by a bad batch of CDs, which fail in a short time. 3 The multiple-write CD-ROMs are made and read with Adaptec DirectCD software. service level agreement
Hardware for the archive and reporting To plug into the disaster recovery plan of Table 76, the two data streams are brought together by the catalogue in backreg.xls. It is also useful for making sure that you have enough copies of each archive directory, (you can even check that they are on different brands/batches of media by the different sequence of serial numbers). This spreadsheet contains a single sheet with the following columns: location: the place where the CD-ROM is stored, values = home, vault, bag, retrieve type: The directory tree on the media, also whether it is backup or archive, values = archive1, archive2, data/windows
Geocomputing Management 255 role (months): The role a particular CD is playing in the backup or archive schedule (one complete schedule for each type), values = ““, 1, 2, 6, 12, 24, 60, 120 check: This generates an index from the current date and the given date to indicate the appropriateness of the role. The closer to 0 the better suited the particular CD-ROM is to that role. These can be summed to give an overall indication of the suitability of the selection. It has the formula in Equation 28. Machine: the computer that the data was taken from value = luminiere, cogsworth, sarah, geocadasta, mrspotts, mitzi label: the volume label for the media. This is often backup software dependent, Adaptec Easy CD Writer uses a format of YYMMDD_HHMM for example 040810_1443 for the CD written 10 August 2004 at 2.43 pm. date: the date, in Microsoft Excel format, of the archive/backup description: the details of the directories archived, because these vary from computer to computer. media serial number: The serial number imprinted on the tape or disk. Equation 28 – Microsoft Excel formula to calculate the “check” field. =IF(ISBLANK($C24),"-",ABS((ABS((NOW()-G24))/(31*C24))-1))
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 256
Table 76 emergency recovery plan POLICY as per Table 74 document management policy SYSTEM as per Table 75 backup and restore system archival and retrieval system HARDWARE emergency recovery plan Backup and archive register in Microsoft Excel spreadsheet backreg.xls Boxes of backup and archive disks in date order in office cupboard Selected disks are put in my bag and dropped off at the bank every couple of weeks. Sometimes they may sit in my bag for a couple of days but they are offsite, except on the weekends. Safe-deposit box at the bank, containing 1, 2, 6, 12, 24 and 60 month backup disks/tapes and 5 to 6 copies of the archive directories. 5 year Australia-wide service agreement with Hewlett Packard paid up-front Emergency cash fund ($6 000) for replacement of stolen/ burnt / destroyed equipment and software. The system recovery plan in Table 125 service level agreement
i. ii. iii. iv. v. vi. vii.
The hardware considerations In the exercise section ‘Time and expense allocation to different projects’ you will find an example of how to produce a time and expense report for your own consulting activities. Once the reports have been done you have to give some thought to preserving them. The long currency and large amount of data, usually measured in Terabytes as in Table 77, which then means you have to consider the way you arrange the data on the disk. Table 77 abbreviations and conversion of disk capacity ASCII 7 byte
bit KB MB GB TB
1 -
7 1 -
ASCII 8 byte 8 1 -
kilobyte 8192 1024 1024 1 -
Megabyte 8388608 1048576 1048576 1024 1 -
Gigabyte
Terabyte
8589934592 1073741824 1073741824 1048576 1024 1 -
8796093022208 1099511627776 1099511627776 1073741824 1048576 1024 1
Geocomputing Management 257 For archive purposes there are two types of data. The first is streaming data, such as geophysical data stored in Log ASCII Standard (LAS), SEG-Y formats or historian files from a programmable logic converter (PLC). The conventional archive is to use tape storage library and Figure 27 gives you a calculator to convert the number of tapes of one physical format into the equivalent number of another.
equivalent tapes (pcs)
1000
100
10
1 1985
1990
1995
2000
2005
estimated introduction date Travan cartridge (400 Mbyte)
Travan cartridge (800 Mbyte)
Exabyte (2 Gbyte)
Exabyte (5 Gbyte)
DLT II (20 Gbyte)
DLT III (40 Gbyte)
DLT IV (80 GByte)
LTO (200 Gbyte)
Figure 27 equivalent number of archive tapes For accessing data in a random way, like for geographic information systems (GIS), structured query language (SQL) databases, or Microsoft Excel spreadsheets, you would be better off with a disk for C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 258 archiving, as you can run your program against the write protected archive disk directly. Except for some special cases such as the Schlumberger LIS format, you can also put your streaming data on here as well, but the capacity of these disks is still two orders of magnitude smaller than the capacity of tapes, and you may end up with more disks than you care for if you convert your current tape libraries. With formats that have been created especially for tape, such as LIS, there are utilities such as tape2dsk, are provided in the software Paradigm Geolog, which can write the original tape to disk and embed tape markers in that file so it behaves like a tape file, and you can copy this tape image format (TIF) file to the archive disk like any other file. In Figure 28 there is a graph for calculating how many disks of one type a disk of another physical format can replace.
Geocomputing Management 259
1.E+06
equivalent disks (pcs)
1.E+05 1.E+04 1.E+03 1.E+02 1.E+01 1.E+00 1975
1980
1985
1990
1995
2000
2005
2010
introduction date single sided 5¾” floppy disk (360 KByte) double sided 5¾” floppy disk (720 KByte) high-density 5¾” floppy disk (1.2 MByte) 2.5" floppy disk (1.44 MByte) CD-ROM (650 MByte) DVD (5 GByte) single-layer high definition DVD (15 GByte) double-layer high definition DVD (30 GByte)
Figure 28 equivalent numbers of disks
Selection of a data exchange file format for archiving In 1989 Abercrombiec in her thoughts on “What format to store it in” she was considering full text on disk, optical character recognition, and image processing (text scanning by retrieval terms provided by humans). In 2012 these things are readily available on the laptop with: MS Office documents, Adobe Portable Document files, and the Google search engine; but with random access data you can also give some thought to the format that will be used for the files. In c
Ibid.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 260 fairness to Abercrombie she emphasised that “language standardisation” was critical for the searcher to find what the indexer has marked. She requires that two sets of terminogly be standardised [the “open standards” of the 21st Century] or that there are cross-references [the data exchange formats of the 21st Century]. The following concerns were identified making an evacuation diagram with Table 108. In the case of the Broadview Freemasons Centre a dump file needs to be produced to enable other members of the committee to maintain the file for changes to building. Possible professional quality exports from MapViewer are:
*.SHP ESRI Shapefile suitable for University academics and cartographers *.MIF MapInfo Interchange Format, suitable for scientists and geographers *.DXF AutoCAD export suitable for engineers and drafters
The trick for the Broadview Freemasons Centre is to find something suitable for retired men to adjust the shapes and boundaries. Previously in the ByLaws of the BFmC, a talk on the relics of the lodge room was illustrated with a plan done in Microsoft Word drawing package. This would be a viable outcome for this problem, not the most efficient of drawing software but generally available. The options are
*.CGM Computer Graphics Metafile *.EMF Windows Picture file (enhanced) *.WMF Windows Picture file
This extraction of graphical components was best done with Enhanced Windows Picture file but this had the following flaws:
vertical text such as REGENCY ROAD in this example is broken into individual letters the text is converted to a default face so all kerning to conform to boxes is lost. blocks of text are broken into lines of text arrows are broken down into line segments
Good points I noticed were:
Geocomputing Management 261
component fonts are maintained, in the CGM these are lost. color palettes are honoured horizontal text is treated as single text box extraction of shapes matches the component shapes in Golden Software MapViewer. In CGM and WMF the topology is not recognised. component pictures stay as pictures polylines used for evacuation paths can be renominated as arrows in the Word
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 262
Further reading for IT management? This grimoire is an attempt at providing a rational approach to geological computing or perhaps even a toolkit of Mackie’st ‘fit for purpose tools’. However, in computing there are formal philosophies, which can either be forced to your attention by clerks attempting to subjugate your budget, or used as the basis for a particular solution. The name-dropping philosophies are given in Table 78. Critical points in considering these stories are what I call the concepts of versatility, timeliness, and scalability. Table 78 geological assessment of data-related philosophies date:
client: criteria scalability timeliness versatility philosophy
rate
name: D C B A
HyperText Transfer Protocols Extreme Programming ISO 9001 MS Document Object Model
8 7 7 8
4 2 1 3
1 3 2 4
3 2 4 1
Scalability [Scale-ability] is the ability of the philosophy to handle increasing amounts of activity, data and values of data. This has a metaphor in the natural world where geological hazards can get quickly out of control and increase in size geometrically, a feature which is sometimes called a fractal. Practically this means a two metre breach in a concrete dam wall will kill ten times as many people as a one metre crack. The problem is not always as obvious as a flood, geochemists when contouring their goldfield results must be able to recognise a value of nil that is a measured value of 0, from where the value was below detection limit, and also compared to where there was no measurements taken. Some of the adages
Geocomputing Management 263 you may hear quoted in the work place that refer to this capability of scale-ability are:
It was raining cats and dogs
Related to scale-ability is timeliness: geological events tend to move at a glacial pace, and early intervention in flooding or ground movement will reduce the scale of the damage. A better management philosophy from the geological perspective is one which allows you to fire-fight, muliplex or multi-task the problem. A poorer philosophy is one which requires you to remain on the journey regardless of the circumstances changing; such as the availability of fresh water [this is a realistic situation for software used to plan drilling programmes in Australia], to maintain the metaphor. Some of the adages you may hear quoted in the work place that refer to this capability of timeliness are:
A stitch in time saves nine
Versatility is the ability of the philosophy to accommodate data from several provinces, and generations of different equipment. An example of the first aspect is that while SQL databases, such as Microsoft SQL Server, are like geological maps and they store data in an application independent manner, the time and expense to set them up is long. Also your application software needs to be able to access the data in your custom databases. To get around this the Finder database was purchased by Schlumberger Corporation in the 1990s to provide customers with a pre-formed general database and the links to the Schlumberger software already built. This design was developed in Texas, and like much of the United States oil patch the stratigraphy is so well defined it is actually a tourist attraction, with kids hanging out the windows of cars watching the geological formations continue for miles on end. When Finder now called GeoFrame was bought by Santos Limited at the early in the twentyfirst century, it was intended to be used for the North West Shelf, an area submerged by the Indian Ocean and a relatively unknown region with mysterious shipwrecks like the Batavia, Sydney and the Emden. Consequently, there is a lot of work done by micropaleontologists identifying the stratigraphy of the sea bed to find the ideal drilling targets. The Finder data model relies greatly on downhole geophysical surveys, Schlumberger’s speciality, and stores C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 264 paleontology as a comment. It is impossible to load the full range of the micro-paleontologists work and generate the necessary information. Santos had to maintain a split system with the more versatile Paradigm EposData being used to store the biostratigraphic work. Conversely both GeoFrame and EposData had from the start been written at time of great innovation in geophysical down-hole devices and both had been designed to accommodate measurements from old tools as well as those that hadn’t even been designed yet, and were versatile in terms of taking data from different periods of activity. Some of the adages you may hear quoted that refer to this capability of versatility are:
KISS, keep it simple stupid
This is segueing to those buzz-word philosophies that really can mean anything and are just introduced into the debate to obfuscate. They have real meanings (see the examples with references in Table 80) which have been prostituted to sell particular software, and notso surprisingly a lot have acronyms. A little cynical perhaps, but Bettenay (1989)d explains:
“… none of us allows a fax machine to interpret data, and the same should apply to a computer. Evaluating and interpreting data are the role of the geologist; … By and large, geologists have never been welcome among the cognoscenti of mainframe computer installations. We are notoriously innumerate and prone to disappear for long periods into the bush so our computer experience is interrupted. Worst of all, geologists seem to believe that they can set priorities and deadlines on data manipulation”
d
Bettenay, 'An overview of the use of computers in exploration in Western Australia. .'
Geocomputing Management 265 Ironically, I find more useful the ‘buzz-word free’ rational approaches of hard-core theoretical authors like Sedgewicke. It is his breakdown of processing algorithms that I used in Table 12 to categorise the case studies. Also mentioned on Table 12
Table 12 is Berkmanf who has many rational approaches on the pages of his ‘Field Geologists’ Handbook’. These are industry standards standards, and as such can be used in court as guides of practice. In using those and bringing them into the digital world I have also tried to tie it all together with the exploration management philosophy from Whitea. Most recently, just like IT derived philosophies, there are now also computer and data management philosophies from the geoscience side. It is no longer a matter of nay saying what IT managers put forward, there is also an opportunity to suggest something different. In Table 79 there are other rational approaches put against the same measuring stick of White. Not everything fits into the framework of White, there are variations to the theme, and for example I haven’t encompassed the examination of computer-assisted-learning by Winship (1989)g, though you would expect that learning from field work would be assumed in White’s plan. The authors below that table address other alternative philosophies than those shown in Table 80 and Table 79, which I haven’t had a chance to categorise yet Table 79 a check list for a rational approach to geoscience data management descriptions of phases in geoscience data management your approach: ‘Data Quality Framework’ from Gregory & Cho, 2009h Leach’s ‘stages of a remote sensing investigation’i ‘sub-modules of the VicGCS project’ from O’Brien,2009 j 1 exploration cycle
e f
Sedgewick, Algorithms. Berkman, Field geologist's manual.
g
John Winship, 'Computer-assisted learning in education,' in Computers in Exploration, Australian Institute of Geoscientists Bulletin No 9 (Australian Institute of Geoscientists, 1989). h Paul Gregory and Tammy Cho, 'Anticipating the E&P data quality explosion - a case study on a well drilling data conversion', PESA News no. 102 (2009), pp. 26-28. i Joseph Leach, 'Stages of a remote sensing investigation,' ed. Grant Leslie Jacquier (Parkville, Victoria: 2001). j Geoffrey O'Brien, 'The VicGCS Project: Assessing the CO 2 Geological Carbon Storage Potential of the Gippsland Basin', Victorian Supplement 2009 no. (2009), pp. 15-16. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 266 regional research Build Sensor Phase 3: Act field work Integrate Phase 4: Operate preparation of results Analysis Phase 1 : Assess project review Model Report proposal for further work Manage Problem Phase 2: Plan statutory reporting Target Phase 3: Act NOTES 1 The ‘exploration cycle’ are the general exploration work phases from White (1997)k and are extracted to this model in Table 60
k
White, Management of mineral exploration.
Anonymous (1999a) Anonymous (1999b) Bennet (1988) Britten (1994) Chimblo et al (1992) Eggo & Harvey (1989) McCormack (1994) Pearson (1999) Peebler (1996) Ruttan (1994) Waltho (1999) Yourdon (1996) D’Angelo & Troy (2000)
Geocomputing Management 268
Further reading regarding Reference & indexing BETTENAY L. F. 1989. An overview of the use of computers in exploration in Western Australia. In: Computers in exploration, pp 916. Australian Institute of Geoscientists Bulletin No. 9. BETTENAY L. F. & CARROLL G. W. 1989. Selected computer resources for geologists in Western Australia. In: Computers in exploration, pp 9-16. Australian Institute of Geoscientists Bulletin No. 9.
Mitchell (1989) Whitfield (1993) Laughton (1994) Sugden (1999)
Further reading regarding analyses & processing Bowler (1987) Gasmier (1987) Jones (1988) Miller (1988) Morris (1988) BETTENAY L. F. 1989. An overview of the use of computers in exploration in Western Australia. In: Computers in exploration, pp 916. Australian Institute of Geoscientists Bulletin No. 9. Morris et al. (1989) Rock (1989) Snowden (1989) Wheatley (1989) Bolt (1992) Downey (1998)
The future for corporate information & data sharing Yacopetti and Mundella do give guidance on what your aim should be with what they call a Geoscience Information Management System (GIMS) which features:
Professionally designed, developed and maintained
a Yacopetti and Mundell, 'Improving the quality of geoscientific information.'
Geocomputing Management 269
Database hosted by a server based Enterprise Level RDBMS (e.g. Microsoft SQL Server) User friendly graphical user interfaces Open and persistent data models Support for geoscientific data types and interoperability with client systems Built-in technology redundancy
However, they are writing from the point-of-view of a software providor (acQuire Technology Solutions Pty Ltd) to a corporate mining company. In particular they are scathing of spreadsheet based solutions to sharing data. I did try the Data Entry module of acQuire in 2005, and I would still prefer to use printed forms. The arguments I gave in the Computers in Geology newsletter many years ago, stiil hold true. However, the acQuire Solution modules are comprehensive and cover the full range of geological laws as shown on my web-siteb, but the problem is the cost. To achieve this for more modest work you may prefer the assistance of the following authors. If you are thinking of do-it-yourself, I have continued with the ELASTIC data model c beyond the Microsoft Excel prototype outlined in my 1998 paperd with an implementation in Microsoft Access that may reduce your development time. BETTENAY L. F. 1989. An overview of the use of computers in exploration in Western Australia. In: Computers in exploration, pp 9-16. Australian Institute of Geoscientists Bulletin No. 9.
Bolt (1992) Ryburn (1994) West (1999) Pearson (1999) Anonymous (1999) Ho & Rockett (1989) Mitchell (1989)
b See the table of geological software at http://www.grantjacquier.info/home_files/softinfo.htm c Grant L Jacquier, 'Enigmatic, long and skinny tables increase comprehensiveness in the ELASTIC data model for an electronic field book. ', The Great Australian Byte no. 4 (1997), pp. 2-6. d Grant L Jacquier, 'Microsoft Excel proves the best prototyping tool for investigation software based on the ELASTIC data model,' in 14th Australian Geological Convention No 49 (Townsville: Geological Society of Australia, 1998). C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 270
Chapter 3 – RESULTS: improving your capability These exercises are given in order of difficulty, so that an inexperienced computer user can ramp up their skills. A geologist building their system as they do their investigation would be better to follow the order given in the narrative of the previous chapters. The work does assume a level of competence beyond your basic introduction to Microsoft Office, that you can take at the community college for example you should know how to:
Make a check list in a Microsoft Excel spreadsheet, including inserting a symbol for a check box in a cell and using the Data Filter to control the checks shown when printing the check list out;
Geocomputing Management 271
A glossary of your special words with dictionary files If you are using this grimoire you are a specialist of some sort and specialists use special language. Some of those terms may be verbiage but there are other terms you simply must spell correctly and explain. These are some I have come across myself:
geographic names Surnames of key personnel Botanical names for weeds and protected flora Company names involved in your business Software names
It does not hurt to have a running database of descriptions. It is also a convenient place for storing short curriculum vitae of historical figures (as they are never at hand when you need them for a presentation). What I find is really useful is to generate dictionary files, a list of the head words, so that Microsoft Word, and since Office 2010, the other programs in the suite, recognise the names. I use the several dictionary files summarised in Table 80 and I have found I save time by not having to push the ignore button of the spell-checker, then late in proof-reading find I was missing the odd letter from a typing error. Eventually, when you have most of your own special words in the dictionary the red wriggly line will become a reminder to add that new special word to the glossary, and the cycle of work will be complete and it will be more effective to extend the data set than put off documenting new terms. In a later section I show you how to print out the glossary and attach it to a document say for a submission to a parliamentary committee. The key for me to this work is bit of software I find I am using more and more: Thomson EndNote but you could use Microsoft Excel or Microsoft Access in its place, if you are prepared to do the design and setting up of the database yourself. EndNote is described by Thomson as “the complete reference solution” but I find its use as a bibliographic database, to store catalogues of other files and documents, the most critical. In effect our glossary is a bibliographic database with many of the headword descriptions just abstracts of other documents and in EndNote you can make a direct link to these source documents if you have them on your web-site. The work to C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 272 make the glossary database and extract the dictionary files has several steps: 1. When you are typing your work add some of the special words that are highlighted to your CUSTOM dictionary. 2. Set up your database if you are not using the prepared template ‘MSdic’ in Thomson EndNote. 3. Identify any terms for the glossary by examing the words you have listed in your C:\Users\...Proofing\CUSTOM.DIC file against the Concise Oxford Dictionary. Similarly, any proper nouns can be added to contacts in Microsoft Outlook. 4. Use the undefined terms from the CUSTOM.dic file to make entries in your glossary database. Repeat as often as you like. Remove the words from the CUSTOM.DIC once you have recorded them so that there is only one authority. 5. Set up the format for writing the dictionary format (*.DIC) files and extract the headwords from your glossary 6. Import the dictionary files into Thomson EndNote and Microsoft Office 7. Use Microsoft Word for writing prose and find a special word that is underlined in red and spelt properly 8. Begin again at step 1. The commands used to make the dictionary for Microsoft Office are given in Equation 29. This assumes that you have made a directory to keep your custom proofing tools, and in my case it is the directory .\Profiles\Proof\ in the DATA folder on my C: drive of my laptop. Once you have made the dictionary file you can load it into the different editing software as per the section ‘Adding your custom dictionaries to Microsoft Office and Thompson EndNote’. Equation 29 commands to make a dictionary from a Thomson EndNote database File | Open | c2008011.enl Edit | Output Styles | New style… Bibliography | Templates | Insert Field Title File | Close Style File Save As: MSdic Yes File | Export File: C:\DATA\Profiles\Proof\glossary.DIC File Type: Text (*.txt) Output Style: MSdic
Geocomputing Management 273 OK
When I moved from Windows XP (machine name: MRSPOTS) to 64bit Windows 7 (machine name: MITZI) I found that the previous dictionary files for Microsoft Word 2003 were incompatible with Microsoft Word 2010 and when I attempted to load them during the set up of MITZI it returned the message “Files without Unicode encoding can’t be added to the dictionary list. Save the file as a Unicode file to add it to the dictionary list”. I converted the ANSI coded dictionary files to the new standard required for 64-bit Windows 7 by using the Microsoft Windows commands in Equation 30. Equation 30 converting an ANSI coded glossary.DIC file to the Unicode standard used with Microsoft Word 2010 Rename Temp OK Open with… Notepad File | Save As… File name: glossary.DIC Save as type: Text Documents(*.txt) Encoding: Unicode Save
For the future, I can see this concept of controlled words extending further with both Legacy Family Tree and Golden Software MapViewer using formal gazettes. This use is discussed in the PinMap section of Golden Software on-line help, and example files are provided with the release. Legacy also provides a geographical gazette which can be added to and there are specialized place name editing utilities built-in to cope with variation of geopgraphical names in birth, death and marriage certificates.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 274
Table 80 custom dictionary files for Computers in Geology, including buzzwords, and where you can find formal definitions HEAD WORD SPECIFICATION published dictionary Introduction to computers and information processing, Long 1988e e.g.: decision support systems (DSS); expert system; information resource management (IRM); knowledge base; management information system (MIS)
LEGEND O is the outcome or output where the dictionary terms are used I is the source of the file data
for a cheap general IT dictionary try something like: KENNEDY J. (ed) 1993 PC Dictionary. Federal Publishing Company, Alexandria, NSW. Wikipedia, en.wikipedia.org e.g.: extreme programming Concise Oxford Dictionary review papers e.g. Winter 2008 on “spatial information” 4 Directory and file name program use C:\DATA\Profiles\Proof\glossary.DIC Y n ? Y Y I O C:\DATA\Profiles\Proof\propnoms.DIC n n n n n I O C:\DATA\Profiles\Proof\c_in_g.DIC 2 n Y ? ? ? I O C:\DATA\Earth\research-notes01 3 n n n n Y I O editor 1 text teditor Microsoft Outlook Microsoft Access Thompson EndNote Microsoft Excel, Microsoft PowerPoint, Microsoft Word LEGEND n this file does not contain headwords found in the particular published dictionary ? this file may contain a word from this dictionary Y this file does contain headwords found in the particular published dictionary NOTES 1 If you don’t have these programs on your computer, you can just keep separate text files with Microsoft Notepad or use a Microsoft Excel spreadsheet and export the text files with Unicode encoding. 2 I keep the c_in_g.DIC file for terms absent from the supplied Microsoft dictionary but given in the Concise Oxford Dictionary and so do not need to be in the glossary. 3 The file research-notes01.txt provides term list for the EndNote file with produces at least the biblio.xml, projlist.xml export files 4 Winterf isolated three defintions for spatial information: Any information about a location space or time (ANZLIC) e f
Long, Introduction to computers & information processing, 2nd edition. Winter, 'What is the Value of Spatial Information?', no.
Geocomputing Management 275
Information about objects or phenomena that are associated with a location relative to the surface of the earth (Association of Geographic Information) SI describes the physical location of objects and the metric relationships between objects (“The value of spatial information” study)
Adding your custom dictionaries to Microsoft Office and Thompson EndNote You will need to adjust Microsoft Office to indicate where to find the custom dictionary you have made, then delete the old entries in the default so that there is only one authority. The commands for Microsoft Office 2010 (at least Microsoft Word and Microsoft PowerPoint) are in Equation 31. You will need to do this for everyone who has an account on your computer as each user account needs to be setup to point to the new file. Equation 31 modifying the dictionary in Microsoft Office 2010 File | Options | Proofing Custom Dictionaries… Add… C:\DATA\profiles\Proof\glossary.txt OK Edit Word List… CUSTOM.DIC(Default) Delete All OK
In Microsoft Office 2003 I couldn’t work out how to set Microsoft PowerPoint to use the dictionary, I was just hoping that the Microsoft Word option in in Equation 32 would change the options generally. Equation 32 Adding your glossary to the custom dictionaries in Microsoft Word Tools | Options… | Spelling & Grammar Custom Dictionaries… Add… C:\DATA\Profiles\Proof\glossary.DIC OK OK OK
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 276 Also you can use the Microsoft DIC file you just made to, load back into Thomson EndNote as a EndNote custom dictionary, the commands are given in Equation 33. If nothing else, it will correct the cross-referencing of headwords in the glossary narrative, just save you that little bit of embarrassment from the hecklers at your next public meeting. The commands in Equation 33 follow on after you have opened Thomson EndNote, loaded a library (*.enl file) and clicked on a reference to open it up. If you are concerned about which dictionaries supplied by Thomson, there are quite a few supplied and mentioned in the help, I use sscebr.tlx (British English), accent.tlx (slang words), and correct.tlx (mis-spellings of words and their corrections). Equation 33 adding your glossary to the custom dictionaries in Thomson EndNote Tools | Spell Check Dictionaries… New File… Browse C:\DATA\Profiles\Proof\glossary.tlx Language: British English OK Import… Files of type: All files (*.*) File name: C:\DATA\Profiles\Proof\glossary.DIC OK Close
Geocomputing Management 277
A convention poster in Microsoft Publisher Microsoft Publisher is included with the Professional Edition of Microsoft Office. At Christmas time my mother was always showing me letters, cards and certificates generated by her friends on this desktop publishing software and at family reunions there are banners printed from laser printers over the marshalling points, but it also has features for the scientist and builder:
general business stationery templates mailing labels of different types and sizes CD-ROM labels and cover insert templates do the livery for your web-site and maintain it afterwards making posters from mosaics of prints from standard printers
If you are working in the bush, you don’t always have time to drive down and print out drafts of your map or poster at a printer bureau. Similarly when I was doing a poster for a convention of the Geological Society of Australia, the Australian Earth Science Convention 2006 in Melbourne, I was funding the work myself and bureau printing was too expensive for drafts. Therefore, this feature to use an ordinary printer for these drafts was ideal for me. Each of the templates are available in Microsoft Publisher has a range of styles, and there are also web page, business card and other business forms designed ready for your use, in a consistent business-like format and style. For example my formal web pages on the www.grantjacquier.info/home.htm site, reflect the "Blends" style with "Wildflowers" colour palette that I use for 'Computers in Geology' business documentation. I find the templates generally good with the exception of a bookplate for a presentation gift, when I wanted something more sincere. I used Microsoft Word with a onecell table within a one-cell table, dashed border on the outer table for the cut-line, rope-border on the inner; the inscription (centred Corsivo Mono font) and border in indigo , the names in Arial black; close down the table boundries to the size you want and it looked really good. C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 278
Table 81 check list to layout a poster in Microsft Publisher Document number, short title: Background image size:
Date: cm x cm MS Publisher templates and themes (your set up is from Table 115): Blends Wildflower CAPITAL Perpetua Titling other: other: other:
“Poster” template “Flyer” template
Mounting board :Publisher page size: template Officeworks 72 x 47 cm (available) : ANSI D 86.36 x 55.88 cm (5 x 2 A4 pages) Free poster : default “Poster size” (3 x 3 A4 pages) STAGE milestone 1 SELECT AN ORDINARY TEMPLATE IN MICROSOFT PUBLISHER Template has space for the main graphics to be added (e.g. “Flyer” template) Select the options for your company’s theme as per Table 115 MS Office configuration Adjusted the ‘Personal Information’ setting change the page size to ‘poster’ and selct size (e.g. ANSI D… 5 x 2 A4 pages) 3 MODIFY A BACKGROUND Imported picture (xxxx.PNG) expanded to available size for board e.g. 72 x 47mm Alternatively image is tiled across page (for poster) 25% transparent white layer added on top Shaded picture saved as file (xxxx.BMP) 4 PLACE MARGINALIA AND DETAILS ON PAGE For each draft version Saved as new file name For each item (e.g results of Table 36) Original scale not altered 25% white transparent backing added for a clear layer File saved Summary of changes added to Properties File saved Print previewed to show segmenting and count of sheets 5 PRINT, CUT AND PIECE TOGETHER POSTER Sheets of paper to be re-used have blank backs facing the same way Wiggled the sheets to make sure there are none stuck together Blank side is facing the right way in the printer cartridge All pages printed out For each sheet
tick
Geocomputing Management 279 Document number, short title: Background image size:
Date: cm x cm MS Publisher templates and themes (your set up is from Table 115): Blends Wildflower CAPITAL Perpetua Titling other: other: other:
“Poster” template “Flyer” template
Mounting board :Publisher page size: template Officeworks 72 x 47 cm (available) : ANSI D 86.36 x 55.88 cm (5 x 2 A4 pages) Free poster : default “Poster size” (3 x 3 A4 pages) STAGE milestone Cut the outside sheets on the cut line (first mark-up line) Fold on second mark-up line Glued on second mark-up line 6 REVIEW THE POSTER For each text box/picture Original scale not altered transparent backing intense enough to read text Background not too dark Adjust your project file poster.bat for new filenames
tick
Adding extra figures to the poster Microsoft Publisher is where you bring everything together and prepare the final printout as per the check list in Table 81. This is the area of the destop bublisher and graphic designer so I don’t find Microsoft Publisher always that intuitive, the following paragraphs discuss things I didn’t really understand. To make a background lighter do the commands in Equation 34, being careful to scale the original picture file c2006029.png to cover as much of the poster as possible, and then overlay the rectangle of colour with just a little bit showing at the top of c2006029.png for you to select and group the two layers into one new picture c2006030.png. Don’t forget to use the Help menu for further explanation, if any of the menu commands in Equation 34 are new to you.
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 280 Equation 34 making the poster background lighter Start > All Programs > Microsoft Office > Microsoft Office Publisher 2003 File > Open > c2006028.pub Insert > Picture > From File… > c2006029.png Insert > Picture > Autoshapes… > Basic Shapes > Format > Picture > Colors and Lines Fill/Color: White Fill/Transparency: 75% OK Arrange > Group Save as Picture … > c2006030.png Edit > Delete Format > Background > More backgrounds… > Picture Select Picture… > c2006030.png OK File > Save File > Exit
Notice that in Equation 34, I keep the different versions of the background in separate files: c2006029.png and c2006030.png; so I can change between them if I feel I am still not sure which one to choose. Equation 35 adding a snapshot to the poster Start > All Programs > Microsoft Office > Microsoft Office Publisher 2003 File > Open > c2006028.pub Start > All Programs > Microsoft Office > Microsoft Office Word 2003 File > Open > c2006014.pub File > Print > Microsoft Office Document Image Writer OK c2006014.MDI OK Edit > Copy Image … at this stage you go back to the poster window … Edit > Paste Special… > Device Independent Bitmap OK Format > Picture… > Colors and Lines Fill/Color: White OK Format > Picture… > Size > 30% OK File > Save File > Exit
In June 2006 when I was making my first poster, I also wanted to advertise that I had done the whole poster using this book. The year before I had for the first time got the complete system under
Geocomputing Management 281 $10 000 and I had added to the front cover, a WordArt logo stating that and giving a list of potential readers (the same list I use in the ‘Preface’). You could use the combination of buttons to get a screen dump of the window, as I did for Figure 29 below, but I have trouble getting all the page in the frame and then having to cut it down to size in Microsoft Paint, I just find it very fiddly. However, I have put the book on my website in Microsoft Office Document Image format, a poor man’s version of Adobe Portable Document format, and in Microsoft Office Document Imaging software I can cut a nice snapshot in one command after selecting the front page. In Equation 35 there are the commands to publish a Word document (in your situation it may be the frontispiece of your thesis, report or a business brochure) to MDI format and then do the snapshot, finally pasting it into the poster.
Figure 29 a print preview of a poster showing cut and pasting lines When cutting the sheets use an art knife, ruler and cutting board: cutting the left and top sides at the first (cut) marks to glue onto the bottom and right sides at the second (join) marks. I cut the outside last, using a pair scissors and following the outline of the poster. All three types of guides are shown in Figure 29. I also find that you can C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 282 use recycled paper because, with the background, the print doesn’t generally show through, though try and sort paper of the same type because different surfaces will absorb more or less or the inkjet ink and appear as different shades.
Geocomputing Management 283
A Microsoft batch file for project management When I work to a deadline for a conference or meeting I get a little edgy. I like to start early with something rough and then have lots of iterations, changing and improving the pictures as I have time and come across the data or just change my mind. It may be many weeks between versions so I keep a project file like Equation 97 in the appendix where poster.bat is listed in full. This file can be used from the MS-DOS command prompt with the commands in Equation 36. Equation 36 starting poster.bat from Microsoft Windows start | All Programs | Accessories | Command Prompt cd c:\DATA\BAT poster
There are only six statements used in this type of batch file and these are shown with examples in Equation 37. Statement i., and v. in Equation 37, utilise the two forms of the ECHO statement. Statement i. is to turn off the screen reporting (or on if parameter ON is used), and the statement vi. is to report text to the screen. The statements iii. and iv. are for starting programs with particular files, the latter form holds the batch file in statsis unitl that particular application in this case Microsoft Word is closed. By using the START statement, a file like poster.bat can open all the different documents from a single command. The statement iii. is for keeping a running list of the different files versions that have been used. As a new poster version is created, the new file is listed against the SET statement and the old file documented by prefixing it with the comment statement REM, shown in statement ii. Finally, I use the poster.bat command to add to my research web page in a way similar to Equation 38 in the section ‘Making an HTML file to run a batch file’. Equation 37 statements used for project management in a batch file i. ii. iii. iv. v.
ECHO OFF REM MyDraft=C:\DATA\LETTERS\c2006030.pub SET MyDraft=C:\DATA\LETTERS\c2006031.pub START "C:\Program Files \ MSPUB.EXE " %MyDraft% "C:\Program Files \WINWORD.EXE" %MyLetter%
C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 284 vi.
ECHO "Poster alterations complete!"
The most important statement from Equation 37 for our purposes is the REM statement which allows us to add comments about the project. I find computing people are loathe to use comments, but I think you when you start to apply the data there becomes no such thing as too much comment and I have put together Table 82as a minimum, all of which are shown in the full example of Equation 97 in the appendix. The check list in Table 82 is also used as part of the work detailed in:
Table 83 check list for when writing an XML file
Geocomputing Management 285 Table 82 check list for a document file name of the file used as a document: toc.html biography.html URL of the intranet home for the file: …/home/. …/extranet/.
date: other:
other: STAGE milestone 1 BODY (OR SUBROUTINE OR FUNCTION) COMMENTS nominate file type below Start of code mark (e.g. “ Initialisation of script variables with estimates Script logic or rhetoric (see Table 84 for examples ) Closing clause of the script component Table 83 sub-edit the document file 2 TYPE IN THE INITIAL SECTION file name Date the file was created Author, Affiliation or company of the author, web-site Current research theme Copyright notice naming the client Narrative with ASSUMPTIONS and USAGE (test, interactive, batch) REFERENCE section Sign off remark (e.g “ ====== CODE BEGINS ======”) Table 83 sub-edit the document file 3 END-OF-SCRIPT SECTION Date the file was created Copyright notice End of code marker (e.g. End of code remark (e.g. “====== CODE ENDS ====== ”) DISCUSSION section For each revision date author affiliation For each change revision note (e.g. “ - … “ ) End of script mark (e.g. “”) Table 83 sub-edit the document file Comment delimiters, as recognised in the script wom.bat, Equation 98, in the Appendix : “” HTML files (*.HTM) 2, 3 “/* …*/” SQL file (*.sql) 2 “--“, JavaScript (*.js) “#” standard shell (*.sh, *.csh) C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
tick
Geocomputing Management 286 name of the file used as a document: toc.html biography.html URL of the intranet home for the file: …/home/. …/extranet/.
“//“, JScript (*.js) 3 “” KML file (*.kml) 2, 3 “REM”, MS-DOS batch file (*.bat) “REMARK”, SQL file (*.sql) “2 NOTE…3 CONT”, GEDCOM 5.5 (*.ged) “--”, SQL file (*.sql) Notes:
date: other: other: STAGE milestone “’*” Visual Basic (*.vbs) 3 “” XHTML file (*.htm) 2, 3 “” XML file (*.xsl,*.xml) 2, 3 other:
tick
Librarians often cite Keywords (categories) typed into a key field (see the help in Thomson EndNote, or below the abstract in any article of the Journal of Earth Science published by the Geological Society of Australia). However you need a search thesaurus to go with that and I have never been that keen. Also supposed the … elements ar used at least in XHTML yet apart from Mozilla which shows them as properties I haven’t found anything which will use them and I really wonder if they are worth the trouble when you can read free text more easily. At the start of there is a ready-reckoner of delimiters for remarks and comments, depending on the script type. Some which require a start-of-line and an end-of-line delimiter are separated there by an ellipsis “…” representing the comment. If you are using Microsoft Script Editor and you using the delimiters in HTML, XHTML, Visual Basic, Jscript or XML, will result in the comments being displayed in green text.
Geocomputing Management 287
An HTML file to keep track of your projects A Hyper Text Markup Language page displayed in Microsoft Internet Explorer is an ideal way of showing off project documents as you can post it on your own web site. This example assumes you have a batch file poster.bat (and the section ‘Making a poster for a convention’ shows you how to do this). This poster.bat file can also be used to open the different documents from a single command, and that command I add to my research web page in a way similar to Equation 38. In doing so, there is a computing advantage in that I don’t have to mount all the folders, where I keep my Microsoft Office files for clients, on the Intranet and this stops anyone accidentally browsing say confidential client reports. Equation 38 XHTML extract showing a link to the project file poster.bat Need to invest in research? Grant Jacquier is working on these prototypes:
This is good if you already have an HTML (or an XHTML) file to bolt this bit of code into. If you don’t, you will need to make one and the components you will need are. 1. Basic structure with documentation and script elements 2. Special elements for that particular file C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 288 The check list in Table 83 gives some milestones in preparing an XML file that is an Extensible Markup Language file. This would make an XHTML file that is the tags will be lowercase for example instead of HTML file where the tags are uppercase, that is . There are some other differences as well, see the section ‘XML provides versatility in data handling’ below, but if you follow the check list it will still display in your browser. Other check lists required for this work are:
Table 82 check list of file documentation Table 84 check list of basic XML structure
The check list in Table 83 is also used as part of the work detailed in:
Table 99 check list for making a catalogue of files The section ‘Making a GIS for an investigation site’
Finally, when writing scripts it is easier if you know what the continuation characters are, so you can lay out your script more clearly. So far I have collected:
Microsoft Visual Basic “_”
Geocomputing Management 289 Table 83 sub-editing a document file Project code name:
date:
URL of the carrier or base file: 0
STAGE milestone 1 PREPARE THE STANDARD DOCUMENT XML banner present (“”) Table 84 check list of basic XML structure 1 File reads in Microsoft Explorer File loads into Internet Explorer without errors Altered the JavaScript elements File loads into Internet Explorer without errors 2 ADD THE SPECIAL ELEMENTS (choose one or more) Table 84 check list of basic XML structure 1 Choose the special sections as below For each bit do Section marked below File loads into Internet Explorer without errors Example sections used ( tick one or more): Equation 38 XHTML extract showing a link to the project file poster.bat Equation 39 DTD (Document Type Definition) statements for various XML Figure 30 essential elements for an HTML file Equation 58 structure of the EndNote proprietary XML format Equation 62 the initial lines of world.kml … Equation 63 extract of world.kml … Equation 64 KML entry using the geographic coords … Equation 68 the from oman2008.bat Other (please specify):
tick
URL of the load or output file ()
Notes: 1 The essentials for XHTML can be found in Figure 30.
XML provides versatility in data handling In the check list of Table 83 I assume you will implement the particular sub-set of XML with a namespace. This is called the XML Schema method of validation as compared to a DTD (Document Type Definition). The use of namespaces allows me to include VML C:\DATA\C_IN_G\LETTERS\c2015003.docx Last printed 10/4/2016 11:05:00 AM
Geocomputing Management 290 and XML inserts in web pages for diagrams and tables. In Rayg it is explained that the alternative DTD files, the original validation protocol for XML files, are easier to build than XML Schemas, so I would expect any industry-specific DTD to appear before the equivalent schema, and I keep track of those in the Equation 39, in readiness for a special load file. For example I haven’t been able to find an XML schema equivalent for the DTD for WML (Wireless Markup Language), that you would use for information you wanted to show on mobile phones, say if you were setting up a documented trail in a marine park or a sacred site, where you didn’t want to leave placards or have brochures blowing around. Equation 39 DTD (Document Type Definition) statements for various XML subsets
These are other XML Schema namespaces, additional to the ones shown in the check list in Table 83, which I have used. Usually if it is HTML, the prefix is not used that is “xmlns” is equivalent to “xmlns:html” where there are more than one namespace implemented in the document, such as when putting in geological sketches using VML, where “xmlns:v” is used, and all VML tags are prefaced with “v;” for example , while XHTML tags are the usual such as . Equation 40 XML Schema namespaces xmlns=http://www.w3.org/TR/REC-html40 xmlns:kml="http://earth.google.com/kml/2.2” xmlns:maths=”http://www.w3.org/1998/Math/MathML” xmlns:v =”urn:schemas-microsoft-com:vml” xmlns:xsl=”http://www.w3.org/1999/XSL/Transform” xmlns:xsl=”http://www.w3.org/TR/WD-xsl” See the section “XML Schemas versus DTDs” pp 658-659, in Ray and Ray, Mastering HTML and XHTML. g
Geocomputing Management 291 xmlns="http://www.w3.org/1999/xhtml”
Figure 30 gives the specifics for an XHTML file, the most commonly used sub-set of XML which displays as HyperText Markup Language (HTML) in a browser such as Microsoft Internet Explorer or Mozilla Navigator. This particular example is from the perspective of my own intranet and references resources on the Computers in Geology extranet. It features the use of:
a standard stylesheet file extranet/gateway.css to control the fonts and font face used in the browser (view the source of the Computers in Geology toc.html); an icon in file extranet/favicon.ico for marking the page on your favourites page (view the source of the Computers in Geology biography.html) a reference to the Javascript library Raphäel in the Javascript file extranet/gateway.css to give graphical elements in the file (view the source of the Computers in Geology default.htm).
Computers in Geology | 2008 expedition to Oman | KML template
Figure 30 essential elements for an HTML file Each type of XML format has some necessary extra elements before you get to your special customisation. Some like those marked in the fields of Figure 30 instruct Microsoft Script Editor [the special editor that comes with Microsoft Office] to use a different dictionary when checking your code. I cannot remember all the different variations and nuances so I think this editor and this feature are essential. This isn’t 100% compliant XHTML, but I expect it will be handled reasonably well by most browsers and editors, in particular I have found that Microsoft Script Editor doesn’t recognise strict XHTML, such as and marks as an error the “/>” which as it is an “empty” tag, ( in that it has no text enclosed by tags , the converse is an example like Computers in Geology ) is required under strict XHTML. Then again, if anyone is writing their geological reports as Shakespearean sonnets, e-mail me, and I will happily write them a conforming XHTML script to match.
Geocomputing Management 293
Table 84 audit for the basic structure of any XML file base file: toc.html URL of the carrier or base file: ..\BILBY\...\publish STAGE milestone
date:
other:
SET UP THE XML FRAMEWORK Decide your base format XSL, XML etc. (tick 0 column) initial elements present as below Altered the heading field and other essentials 1 review “to-do” list add clauses to revision history 2 CONSIDER THE STRUCTURED CONTENT Nominate the output type (item 1) The URL of the output URL written below opening elements ( <…> )are matched by closing elements (…> ) for XML all element names are lower case (e.g. for XHTML) for HTML all element names are upper case (e.g.
for HTML) for XML, single elements are closed ( e.g. for HTML, single elelemnts are not closed (e.g. ) 3 GENERAL GRAMMAR CHECKS All attribute values are enclosed in double quotations (e.g. class=”gaterail” ) All parameters in attributes preceded by dollar sign (e.g. style=”$header”) Text test values are given single quotes (e.g. select=”research-notes!=’Project Bilby’” The encoding=”UTF-8” in xml processing instruction to handle text formatting characters reserved XML characters are escaped in any text or narrative Ampersands (&) should be ‘&’ ot replaced by “and” Greater than signs should be ‘>’ or replaced by “greater than” Less than signs should be ‘<’ or replaced by “less than” carriage returns maybe given as ‘
’ tabs are sometime interpreted wrongly in XSL(T) processing when given as SPECIFICATIONS FOR FILES file suffix Opening elements (tick those used): 0 CSS (*.css) 2
GEDCOM 5.5 (*.ged) 0 HEAD … 0 TRLR JavaScript (*.js) function … (…) { …} KML (*.kml)