Remove empty lines from a file using Powershell.
secretGeek .:dot Nuts about dot Net:.
home .: about .: sign up .: sitemap .: secretGeek RSS

Remove empty lines from a file using Powershell.

I needed to remove the blank lines from a file.

Normally when I need to do this, I use a regular expression in TextPad. (replace "\r\n\r\n" with "\r\n"... and iterate) -- but TextPad wasn't available on this machine, and I couldn't connect to the internet to grab it.

So I fired up PowerShell and messed around with the syntax until it worked.

gc c:\FileWithEmptyLines.txt | where {$_ -ne ""} > c:\FileWithNoEmptyLines.txt

I don't know if that was the prettiest way to do it -- but I got the result I needed ;-)

The nicest thing was that I didn't need to look anything up -- I just tried variations until I got the result I wanted. I didn't remember the syntax of the 'where' statement or the 'not equal to' operator -- I guessed and got them right within one or two guesses. Nice language design, Bruce!

(I didn't even remember the command 'gc' -- but since i wanted the powershell equivalent of the 'type' command, so i entered 'alias type' and found 'Get-Content' is the powershell equivalent of 'Type' which i guessed was also known as just 'gc')





'http://' on Sun, 18 Mar 2007 23:55:02 GMT, sez:

Reinventing the wheel?
cat FileWithEmptyLines.txt | grep -v ^$ > FileWithNoEmptyLines.txt

or even just:
grep -v ^$ FileWithEmptyLines.txt > FileWithNoEmptyLines.txt

Why do we need another set of shell commands for people to have to remember?



'Bert' on Mon, 19 Mar 2007 00:12:46 GMT, sez:

grep? cat? hello?? not exactly standard on a windows machine.

besides -- powershell does a whole lot more than any unix shell can do.



'lb' on Mon, 19 Mar 2007 00:14:59 GMT, sez:

@{anonymous coward}

>another set of shell commands for people
>to have to remember

no -- you miss the point. I didn't have to remember anything, and i didn't even need to use regular expressions in this case.



'Chris' on Mon, 19 Mar 2007 01:15:56 GMT, sez:

If you type 'Cat' in powershell, then the alias 'Cat' is used which is just an alias to 'Get-Content'

So that is one less thing to have to remember.

Although there's no syntactic equivalent to grep, you could use this syntax:

cat c:\HasEmptyLines.txt | where {$_ -notmatch "^$" } > c:\NoEmptyLines.txt



'lb' on Mon, 19 Mar 2007 01:41:32 GMT, sez:

Here's two ways to measure the length of the resulting file...

$count=0 ;; gc c:\NoEmptyLines.txt | foreach{$count++;} ;; $count


gc c:\NoEmptyLines.txt | Measure-Object



'lb' on Mon, 19 Mar 2007 05:00:23 GMT, sez:

and here's a way to analyze a multi-line string (without putting it into a file first) (and you'd have to escape any double quote chars)

> "
>> cdcdscsdcsdd
>> " | where {$_ -ne "fred"} > c:\fred3.txt
>>


And if the script is going to contain " characters but you don't wanna escape them...

--> Running a Powershell comparison against a multiple line piece of text (without putting it into a file first)
> @"
>> cdcdscsdcsdd
>> "@ | where {$_ -ne "fred"} > c:\fred3.txt
>>



'Barry Kelly' on Mon, 19 Mar 2007 18:19:19 GMT, sez:

@Bert: Unix tools are certainly standard on my machine, can't live without Cygwin.



'lb' on Mon, 19 Mar 2007 23:50:43 GMT, sez:

yeh but barrkel, you're a special case. ;-)

people who work on compilers are generally very far outside any kind of normal consideration.



'hari kiran' on Wed, 10 Oct 2007 03:46:02 GMT, sez:

hi friends i need help in coding



'aaron' on Wed, 23 Apr 2008 19:14:03 GMT, sez:

Yeah, Cygwin rocks!



'nisse' on Wed, 17 Sep 2008 13:03:16 GMT, sez:

no need to use two files for this


(get-content C:\File.txt) | where {$_ -ne ""} | out-file c:\file.txt


will read and write from/to the same file



'Hernan Rojas' on Fri, 15 Apr 2011 22:00:16 GMT, sez:

Here I'am sharing my script which list all domain controllers from my domain and then delete the empty (blank) lines from the generated file:

$file = "\\WDC1A\E$\ScriptsAD\DCList1.txt"
import-module ActiveDirectory
Get-ADDomainController -Server domain.com -Filter * | Sort-Object name | Format-Table name -HideTableHeaders | Out-File $file

Get-Content $file | where {$_.Length -ne 0} | Out-File "$file`.tmp"
Move-Item "$file`.tmp" $file -Force



'Ben Northway' on Tue, 17 Jan 2012 17:02:25 GMT, sez:

My version:
(gc file.txt) | ? {$_.trim() -ne "" } | set-content file.txt

The parenthesis causes the command to finish before proceeding through the pipline. Or else the file would be locked and we couldn't write to it.
The trim() method removes lines that contain spaces but nothing else which is what I needed in my case.

PowerShell is pretty handy!




name


website (optional)


enter the word:
 

comment (HTML not allowed)


All viewpoints welcome. But the right to delete any post for any reason is reserved. Don't make me do it. Aim for constructiveness. Comments may be republished, emailed to your loved ones or printed and used as toilet paper. Also, I get particularly nasty on comment spam. It's not worth even trying to post comment spam here -- your html is escaped, and your links are given a rel='nofollow'. By attempting to post a comment, you understand that if the comment is considered spam, at my absolute discretion, your IP address may be used as the target of a prolonged distributed denial of service attack. Your electricity might suddenly stop working. Your car tyres will go mysteriously flat. You will suffer permanent hairloss. Your dreams will be filled with terrifying monsters. And in any case I reserve the right to record and publish your IP address.

 

TimeSnapper is a life analysis system that stores and plays-back your computer use. It makes timesheet recording a breeze, helps you recover lost work and shows you how to sharpen your act.

 

NimbleText - FREE text manipulation and data extraction

NimbleText is a Powerful FREE Tool

Use it for:

  • extracting data from text
  • manipulating text
  • generating code

It makes you look awesome. Use it right now! Go on! Hurry! Don't walk, run!

 

Articles

Mind-boggling Demo of New Gaming Genre, aka Folder-Based Hangman, aka Fun with Recursion Mind-boggling Demo of New Gaming Genre, aka Folder-Based Hangman, aka Fun with Recursion
Got CSV in your javascript? Use agnes. Got CSV in your javascript? Use agnes.
I went to write down a book name and founded an internet empire instead. I went to write down a book name and founded an internet empire instead.
NimbleText: Origins NimbleText: Origins
The Windows 8 Mullet The Windows 8 Mullet
Cosby: spontaneous striped background generator Cosby: spontaneous striped background generator
Slides from WDCNZ: Live Coding Asp.net MVC3 Slides from WDCNZ: Live Coding Asp.net MVC3
MVC 3, MVC 3, "Third Times a Charm" references
Custom Errors in ASP.Net MVC: It couldn't be simpler, right? Custom Errors in ASP.Net MVC: It couldn't be simpler, right?
Anatomy of a Domain Hijacking, part 2: The Website Who Came In From The Cold Anatomy of a Domain Hijacking, part 2: The Website Who Came In From The Cold
Anatomy of a Domain Hijacking, part 1 Anatomy of a Domain Hijacking, part 1
secretGeek.net domain has been stolen. The site may go down. secretGeek.net domain has been stolen. The site may go down.
Boring article: 'untrusted domain' issue with SQL Server. Boring article: 'untrusted domain' issue with SQL Server.
Coding While You Commute Coding While You Commute
Test Driven Dentistry Is A Good Thing Test Driven Dentistry Is A Good Thing
The 'less crashy' release of NimbleText The 'less crashy' release of NimbleText
Rethinking Toolbars in Visual Studio (or any IDE) Rethinking Toolbars in Visual Studio (or any IDE)
Where shall we have lunch? Where shall we have lunch?
Setting up email for your microIsv Setting up email for your microIsv
The NO Visual Studio movement: Compiling .net projects in Notepad++ The NO Visual Studio movement: Compiling .net projects in Notepad++
ZeroOne: the editor for programmers who think in binary ZeroOne: the editor for programmers who think in binary
Mercurial workflow for personal projects (with a .net bias) Mercurial workflow for personal projects (with a .net bias)
I see you're using vim. Let me fix that for you. I see you're using vim. Let me fix that for you.
The worst recruitment spam I've ever read The worst recruitment spam I've ever read
A thank you I forgot to say A thank you I forgot to say
My new product, NimbleText, is live My new product, NimbleText, is live
Grabbing the free songs of Jonathan Coulton (with Powershell) Grabbing the free songs of Jonathan Coulton (with Powershell)
Using NimbleSet to compare lists Using NimbleSet to compare lists
Wanted: Wiki Lists (dot org) Wanted: Wiki Lists (dot org)
DOS on Dope: The last MVC web framework you'll ever need DOS on Dope: The last MVC web framework you'll ever need
JSON Query Languages: 5 special purpose editors JSON Query Languages: 5 special purpose editors
What then, is b? What then, is b?
SQLike: A simple editor SQLike: A simple editor
Yet Another BizPlan Generator. Yet Another BizPlan Generator.
HOT GUIDS: A hot or not site for guids HOT GUIDS: A hot or not site for guids
How does life get better? One tiny hack at a time. How does life get better? One tiny hack at a time.
24 things to do, and 100 things *not* to do (yet) for building a MicroISV 24 things to do, and 100 things *not* to do (yet) for building a MicroISV
Venture capital won't kill Jeff Atwood, it will only make him Jeffer. Venture capital won't kill Jeff Atwood, it will only make him Jeffer.
A handy workflow image for newbie mercurial users A handy workflow image for newbie mercurial users
Fractal Feedback, a diversion into recreational programming Fractal Feedback, a diversion into recreational programming
Hump-Jumping: How the Education of Computer Science can be Saved, err, maybe. Hump-Jumping: How the Education of Computer Science can be Saved, err, maybe.
Suggested User Experience Improvements for DiffMerge Suggested User Experience Improvements for DiffMerge
SQL Style Extensions for C# SQL Style Extensions for C#
The Movie Hollywood (And My Wife) Doesn't Want You To See: Weekend at Jacko's The Movie Hollywood (And My Wife) Doesn't Want You To See: Weekend at Jacko's
Sysi: the ultimate administrators toolkit Sysi: the ultimate administrators toolkit

Archives .: secretGeek :: Complete Archives
TimeSnapper -- Automated Screenshot Journal TimeSnapper.com    
Version 3.3: true productivity boost

Next Action NextAction
Managing the top of your mind

NimbleText -- World's Simplest Code GeneratorNimbleText -- World's Simplest Code Generator, Text Manipulator, Data Extractor

25 steps for building a Micro-ISV 25 steps for building a Micro-ISV
3 minute guides -- babysteps in new technologies: powershell, JSON, watir, F# 3 Minute Guide Series
Universal Troubleshooting checklist Universal Troubleshooting Checklist
Top 10 SecretGeek articles Top 10 SecretGeek articles
ShinyPower (help with Powershell) ShinyPower
Now at CodePlex

Realtime CSS Editor, in a browser RealTime Online CSS Editor
Gradient Maker -- a tool for making background images that blend from one colour to another. Forget photoshop, this is the bomb. Gradient Maker


[powered by Google] 


How to be depressed How to be depressed
You are not inadequate.



Recommended Reading


the little schemer


The Best Software Writing I
The Business Of Software (Eric Sink)

Recommended blogs

Jeff Atwood
Joseph Cooney
Phil Haack
Scott Hanselman
Julia Lerman
Rhys Parry
Joel Pobar
Thomas White
OJ Reeves
Eric Sink

Aggregated Links

proggit
dzone
hacker news
dot net kicks

Human Link Machines

interesting finds
a continuous learner's weblog
arjan's world
weekly link post

LinkedIn profile
LogEnvy - event logs made sexy
Computer, Unlocked. A rapid computer customization resource
PC Smart Buys - Computer Hardware in Australia
 
home .: about .: sign up .: sitemap .: secretGeek RSS .: © Leon Bambrick 2006 .: privacy

home .: about .: sign up .: sitemap .: RSS .: © Leon Bambrick 2006 .: privacy