Re: help: pandas and 2d table

[Tim Williams via Python-list]

On Sat, Apr 13, 2024 at 1:10 PM Mats Wichmann via Python-list <
python-list@python.org> wrote:

> On 4/13/24 07:00, jak via Python-list wrote:
>
> doesn't Pandas have a "where" method that can do this kind of thing? Or
> doesn't it match what you are looking for?  Pretty sure numpy does, but
> that's a lot to bring in if you don't need the rest of numpy.
>
> pandas.DataFrame.where — pandas 2.2.2 documentation (pydata.org)

-- 
https://mail.python.org/mailman/listinfo/python-list

Re: Is there a Python module to parse a date like the 'date' command in Linux?

[Tim Williams]

On Mon, May 22, 2023 at 12:41 PM Mats Wichmann  wrote:

> On 5/20/23 13:53, Chris Green wrote:
> > I'm converting a bash script to python as it has become rather clumsy
> > in bash.
> >
> > However I have hit a problem with converting dates, the bash script
> > has:-
> >
> >  dat=$(date --date "$1" +"%Y/%m/%d")
> >
> > and this will accept almost anything reasonably sensible that can be
> > interpreted as a date, in particular it accepts things like "tomorrow",
> > "yesterday" and "next thursday".
> >
> > Is there anything similar in Python or would I be better off simply
> > using os.system() to run date from the python program?
> >
>
> in the standard library, datetime
>
> as an addon module, dateutil  (install as python-dateutil)
>
> Don't know if either are exactly what you want, but do take a look.
>
> --
> https://mail.python.org/mailman/listinfo/python-list


In particular,check out dateutil.parser.
parser — dateutil 2.8.2 documentation


parser


This module offers a generic date/time string parser which is able to parse
most known formats to represent a date and/or time.

This module attempts to be forgiving with regards to unlikely input
formats, returning a datetime object even for dates which are ambiguous. If
an element of a date/time stamp is omitted, the following rules are applied:
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: How to store the result of df.count() as a new dataframe in Pandas?

[Tim Williams]

On Tue, Oct 26, 2021 at 6:36 PM Shaozhong SHI 
wrote:

> Hello,
>
> The result of df.count() appears to be a series object.  How to store the
> result of df.count() as a new dataframe in Pandas?
>
> That is data anyhow.
>
> Regards,
>
> David
> --
> https://mail.python.org/mailman/listinfo/python-list




Have you tried something like

df_count = pd.DataFrame(df.count())
?
(Untested, but I've converted Series objects to DataFrames doing something
similar before.)
This is more of a pandas question. Why don't you ask this on stackoverflow?

https://stackoverflow.com/questions/tagged/pandas
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: ValueError: arrays must all be same length

[Tim Williams]

On Mon, Oct 5, 2020 at 6:47 AM Shaozhong SHI  wrote:

>
> Hi, I managed to flatten it with json_normalize first.
>
> from pandas.io.json import json_normalize
> atable = json_normalize(d)
> atable
>
> Then, I got this table.
>
> brandId brandName careHome constituency
> currentRatings.overall.keyQuestionRatings currentRatings.overall.rating
> currentRatings.overall.reportDate currentRatings.overall.reportLinkId
> currentRatings.reportDate dormancy ... providerId region registrationDate
> registrationStatus regulatedActivities relationships reports specialisms
> type uprn
> 0 BD510 BRAND MACC Care Y Birmingham, Northfield [{u'reportDate':
> u'2020-10-01', u'rating': u'R... Requires improvement 2020-10-01
> 1157c975-c2f1-423e-a2b4-66901779e014 2020-10-01 N ... 1-101641521 West
> Midlands 2013-12-16 Registered [{u'code': u'RA2', u'name':
> u'Accommodation
>
> Then, I tried to expand the column
> of currentRatings.overall.keyQuestionRatings, with
>
> mydf =
> pd.DataFrame.from_dict(atable['currentRatings.overall.keyQuestionRatings'][0])
> mydf
>
> Then, I got another table.
>
> name rating reportDate reportLinkId
> 0 Safe Requires improvement 2020-10-01
> 1157c975-c2f1-423e-a2b4-66901779e014
> 1 Well-led Requires improvement 2020-10-01
> 1157c975-c2f1-423e-a2b4-66901779e014
> 2 Caring Good 2019-10-04 63ff05ec-4d31-406e-83de-49a271cfdc43
> 3 Responsive Good 2019-10-04 63ff05ec-4d31-406e-83de-49a271cfdc43
> 4 Effective Requires improvement 2019-10-04
> 63ff05ec-4d31-406e-83de-49a271cfdc43
>
>
> How can I re-arrange to get a flatten table?
>
> Apparently, the nested data is another table.
>
> Regards,
>
> Shao
>
>
> I'm fairly new to pandas myself. Can't help there. You may want to post
this on Stackoverflow, or look for a similar issue on github.

https://stackoverflow.com/questions/tagged/pandas+json
https://github.com/pandas-dev/pandas/issues




>
> On Sun, 4 Oct 2020 at 13:55, Tim Williams  wrote:
>
>> On Sun, Oct 4, 2020 at 8:39 AM Tim Williams  wrote:
>>
>> >
>> >
>> > On Fri, Oct 2, 2020 at 11:00 AM Shaozhong SHI 
>> > wrote:
>> >
>> >> Hello,
>> >>
>> >> I got a json response from an API and tried to use pandas to put data
>> into
>> >> a dataframe.
>> >>
>> >> However, I kept getting this ValueError: arrays must all be same
>> length.
>> >>
>> >> Can anyone help?
>> >>
>> >> The following is the json text.  Regards, Shao
>> >>
>> >> (snip json_text)
>> >
>> >
>> >> import pandas as pd
>> >>
>> >> import json
>> >>
>> >> j = json.JSONDecoder().decode(req.text)  ###req.json
>> >>
>> >> df = pd.DataFrame.from_dict(j)
>> >>
>> >
>> > I copied json_text into a Jupyter notebook and got the same error trying
>> > to convert this into a pandas DataFrame:When I tried to copy this into a
>> > string, I got an error,, but without enclosing the paste in quotes, I
>> got
>> > the dictionary.
>> >
>> >
>> (delete long response output)
>>
>>
>> > for k in json_text.keys():
>> > if isinstance(json_text[k], list):
>> > print(k, len(json_text[k]))
>> >
>> > relationships 0
>> > locationTypes 0
>> > regulatedActivities 2
>> > gacServiceTypes 1
>> > inspectionCategories 1
>> > specialisms 4
>> > inspectionAreas 0
>> > historicRatings 4
>> > reports 5
>> >
>> > HTH,.
>> >
>> >
>> This may also be more of a pandas issue.
>>
>> json.loads(json.dumps(json_text))
>>
>> has a successful round-trip
>>
>>
>> > --
>> >> https://mail.python.org/mailman/listinfo/python-list
>> >>
>> >
>> --
>> https://mail.python.org/mailman/listinfo/python-list
>>
>
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: ValueError: arrays must all be same length

[Tim Williams]

On Sun, Oct 4, 2020 at 8:39 AM Tim Williams  wrote:

>
>
> On Fri, Oct 2, 2020 at 11:00 AM Shaozhong SHI 
> wrote:
>
>> Hello,
>>
>> I got a json response from an API and tried to use pandas to put data into
>> a dataframe.
>>
>> However, I kept getting this ValueError: arrays must all be same length.
>>
>> Can anyone help?
>>
>> The following is the json text.  Regards, Shao
>>
>> (snip json_text)
>
>
>> import pandas as pd
>>
>> import json
>>
>> j = json.JSONDecoder().decode(req.text)  ###req.json
>>
>> df = pd.DataFrame.from_dict(j)
>>
>
> I copied json_text into a Jupyter notebook and got the same error trying
> to convert this into a pandas DataFrame:When I tried to copy this into a
> string, I got an error,, but without enclosing the paste in quotes, I got
> the dictionary.
>
>
(delete long response output)


> for k in json_text.keys():
> if isinstance(json_text[k], list):
> print(k, len(json_text[k]))
>
> relationships 0
> locationTypes 0
> regulatedActivities 2
> gacServiceTypes 1
> inspectionCategories 1
> specialisms 4
> inspectionAreas 0
> historicRatings 4
> reports 5
>
> HTH,.
>
>
This may also be more of a pandas issue.

json.loads(json.dumps(json_text))

has a successful round-trip


> --
>> https://mail.python.org/mailman/listinfo/python-list
>>
>
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: ValueError: arrays must all be same length

[Tim Williams]

On Fri, Oct 2, 2020 at 11:00 AM Shaozhong SHI 
wrote:

> Hello,
>
> I got a json response from an API and tried to use pandas to put data into
> a dataframe.
>
> However, I kept getting this ValueError: arrays must all be same length.
>
> Can anyone help?
>
> The following is the json text.  Regards, Shao
>
> (snip json_text)


> import pandas as pd
>
> import json
>
> j = json.JSONDecoder().decode(req.text)  ###req.json
>
> df = pd.DataFrame.from_dict(j)
>

I copied json_text into a Jupyter notebook and got the same error trying to
convert this into a pandas DataFrame:When I tried to copy this into a
string, I got an error,, but without enclosing the paste in quotes, I got
the dictionary.

dir(json_text)
['__class__',
 '__contains__',
 '__delattr__',
 '__delitem__',
 '__dir__',
 '__doc__',
 '__eq__',
 '__format__',
 '__ge__',
 '__getattribute__',
 '__getitem__',
 '__gt__',
 '__hash__',
 '__init__',
 '__init_subclass__',
 '__iter__',
 '__le__',
 '__len__',
 '__lt__',
 '__ne__',
 '__new__',
 '__reduce__',
 '__reduce_ex__',
 '__repr__',
 '__reversed__',
 '__setattr__',
 '__setitem__',
 '__sizeof__',
 '__str__',
 '__subclasshook__',
 'clear',
 'copy',
 'fromkeys',
 'get',
 'items',
 'keys',
 'pop',
 'popitem',
 'setdefault',
 'update',
 'values']

pd.DataFrame(json_text)

---

ValueErrorTraceback (most recent call last)
 in 
> 1 pd.DataFrame(json_text)

D:\anaconda3\lib\site-packages\pandas\core\frame.py in __init__(self, data,
index, columns, dtype, copy)
433 )
434 elif isinstance(data, dict):
--> 435 mgr = init_dict(data, index, columns, dtype=dtype)
436 elif isinstance(data, ma.MaskedArray):
437 import numpy.ma.mrecords as mrecords

D:\anaconda3\lib\site-packages\pandas\core\internals\construction.py in
init_dict(data, index, columns, dtype)
252 arr if not is_datetime64tz_dtype(arr) else arr.copy()
for arr in arrays
253 ]
--> 254 return arrays_to_mgr(arrays, data_names, index, columns,
dtype=dtype)
255
256

D:\anaconda3\lib\site-packages\pandas\core\internals\construction.py in
arrays_to_mgr(arrays, arr_names, index, columns, dtype)
 62 # figure out the index, if necessary
 63 if index is None:
---> 64 index = extract_index(arrays)
 65 else:
 66 index = ensure_index(index)

D:\anaconda3\lib\site-packages\pandas\core\internals\construction.py in
extract_index(data)
363 lengths = list(set(raw_lengths))
364 if len(lengths) > 1:
--> 365 raise ValueError("arrays must all be same length")
366
367 if have_dicts:

ValueError: arrays must all be same length


I got a different error trying json.loads(str(json_text)),
---
JSONDecodeError   Traceback (most recent call last)
 in 
> 1 json.loads(str(json_text))

D:\anaconda3\lib\json\__init__.py in loads(s, cls, object_hook,
parse_float, parse_int, parse_constant, object_pairs_hook, **kw)
355 parse_int is None and parse_float is None and
356 parse_constant is None and object_pairs_hook is None
and not kw):
--> 357 return _default_decoder.decode(s)
358 if cls is None:
359 cls = JSONDecoder

D:\anaconda3\lib\json\decoder.py in decode(self, s, _w)
335
336 """
--> 337 obj, end = self.raw_decode(s, idx=_w(s, 0).end())
338 end = _w(s, end).end()
339 if end != len(s):

D:\anaconda3\lib\json\decoder.py in raw_decode(self, s, idx)
351 """
352 try:
--> 353 obj, end = self.scan_once(s, idx)
354 except StopIteration as err:
355 raise JSONDecodeError("Expecting value", s, err.value)
from None

JSONDecodeError: Expecting property name enclosed in double quotes: line 1
column 2 (char 1)

I think the solution is to fix the arrays so that the lengths match.

for k in json_text.keys():
if isinstance(json_text[k], list):
print(k, len(json_text[k]))

relationships 0
locationTypes 0
regulatedActivities 2
gacServiceTypes 1
inspectionCategories 1
specialisms 4
inspectionAreas 0
historicRatings 4
reports 5

HTH,.

-- 
> https://mail.python.org/mailman/listinfo/python-list
>
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: Python Pandas split Date in day month year and hour

[Tim Williams]

On Wed, Aug 19, 2020 at 1:43 PM J Conrado  wrote:

>
>
> Hi,
>
>
> I'm satarting using Pandas to read excel. I have a meteorological
> synoptic data and I have for date:
>
>
> 0   2017-11-01 00:00:00
> 1   2017-11-01 03:00:00
> 2   2017-11-01 06:00:00
> 3   2017-11-01 09:00:00
> 4   2017-11-01 12:00:00
> ..  ...
> 229 2017-11-30 09:00:00
> 230 2017-11-30 12:00:00
> 231 2017-11-30 15:00:00
> 232 2017-11-30 18:00:00
> 233 2017-11-30 21:00:00
>
>
> I would like know how can I get for this array the values for day, month
> and hour:
>
> 2017-11-01 03:00:00   year = 2017  month = 11day = 1and
> hour = 3
>
>
>
> Thanks,
>
>
> Conrado
>
> --
> https://mail.python.org/mailman/listinfo/python-list


I'm also starting to learn pandas. A better place to ask a pandas question
is StackOverflow. Here's a link that may answer your question.

Convert timestamp to day, month, year and hour
<https://stackoverflow.com/questions/57515291/convert-timestamp-to-day-month-year-and-hour>


Tim Williams
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: conda/anaconda and pip3 (pip)

[Tim Williams]

On Saturday, December 8, 2018 at 10:13:14 PM UTC-5, Monte Milanuk wrote:
> Did you find any solution(s)?

I usually just lurk and read on this list. I don't reply since there's usually 
more competent people that regularly post helpful answers. (I lurk to learn 
from them!)

If no one's replied yet, I'll give it my 2 cents ...

Without being a pip expert, I see from 'pip install -h' that you can specify 
where you want the package to be installed.

Install Options:
  -r, --requirement Install from the given requirements file. This 
option can be used multiple times.
  -c, --constraint  Constrain versions using the given constraints 
file. This option can be used multiple
  times.
  --no-deps   Don't install package dependencies.
  --pre   Include pre-release and development versions. By 
default, pip only finds stable
  versions.
  -e, --editableInstall a project in editable mode (i.e. 
setuptools "develop mode") from a local project
  path or a VCS url.
  -t, --target   Install packages into . By default this will 
not replace existing files/folders in
  . Use --upgrade to replace existing packages 
in  with new versions.
  --user  Install to the Python user install directory for 
your platform. Typically ~/.local/, or
  %APPDATA%\Python on Windows. (See the Python 
documentation for site.USER_BASE for full
  details.)
  --root Install everything relative to this alternate 
root directory.
  --prefix   Installation prefix where lib, bin and other 
top-level folders are placed
  -b, --buildDirectory to unpack packages into and build in. 
Note that an initial build still takes
  place in a temporary directory. The location of 
temporary directories can be controlled
  by setting the TMPDIR environment variable (TEMP 
on Windows) appropriately. When passed,
  build directories are not cleaned in case of 
failures.
  --src  Directory to check out editable projects into. 
The default in a virtualenv is "/src". The default for global installs is 
"/src".
  -U, --upgrade   Upgrade all specified packages to the newest 
available version. The handling of
  dependencies depends on the upgrade-strategy used.
  --upgrade-strategy 
  Determines how dependency upgrading should be 
handled [default: only-if-needed]. "eager"
  - dependencies are upgraded regardless of whether 
the currently installed version
  satisfies the requirements of the upgraded 
package(s). "only-if-needed" -  are upgraded
  only when they do not satisfy the requirements of 
the upgraded package(s).
  --force-reinstall   Reinstall all packages even if they are already 
up-to-date.
  -I, --ignore-installed  Ignore the installed packages (reinstalling 
instead).
  --ignore-requires-pythonIgnore the Requires-Python information.
  --no-build-isolationDisable isolation when building a modern source 
distribution. Build dependencies
  specified by PEP 518 must be already installed if 
this option is used.
  --install-option   Extra arguments to be supplied to the setup.py 
install command (use like --install-
  option="--install-scripts=/usr/local/bin"). Use 
multiple --install-option options to
  pass multiple options to setup.py install. If you 
are using an option with a directory
  path, be sure to use absolute path.
  --global-optionExtra global options to be supplied to the 
setup.py call before the install command.
  --compile   Compile Python source files to bytecode
  --no-compileDo not compile Python source files to bytecode
  --no-warn-script-location   Do not warn when installing scripts outside PATH
  --no-warn-conflicts Do not warn about broken dependencies
  --no-binary 
  Do not use binary packages. Can be supplied 
multiple times, and each time adds to the
  existing value. Accepts either :all: to disable 
all binary packages, :none: to empty the
  set, or one or more package names with commas 
between them. Note that some packages are
  tricky to compile and may fail to install when 
this option is used on them.
  --only-binary 
  Do not use source packages. Can be supplied 
multiple times, and each time adds to the
  existing value. Accepts either :all: to disable 
a

Re: Is there a nice way to switch between 2 different packages providing the same APIs?

[Tim Williams]

On Thu, Jul 5, 2018 at 9:02 AM Mark Summerfield via Python-list <
python-list@python.org> wrote:

> For GUI programming I often use Python bindings for Qt.
>
> There are two competing bindings, PySide and PyQt.
>
> Ideally I like to have applications that can use either. This way, if I
> get a problem I can try with the other bindings: if I still get the
> problem, then it is probably me; but if I don't it may be an issue with the
> bindings.
>
> But working with both means that my imports are very messy. Here's a tiny
> example:
>
> if PYSIDE: # bool True -> Use PySide; False -> Use PyQt5
> from PySide2.QtCore import Qt
> from PySide2.QtGui import QIcon
> from PySide2.QtWidgets import (
> QDialog, QFrame, QGridLayout, QLabel, QLineEdit, QPushButton,
> QVBoxLayout)
> else:
> from PyQt5.QtCore import Qt
> from PyQt5.QtGui import QIcon
> from PyQt5.QtWidgets import (
> QDialog, QFrame, QGridLayout, QLabel, QLineEdit, QPushButton,
> QVBoxLayout)
>
> The PYSIDE constant is imported from another module and is used for all
> .py files in a given project so that just by changing PYSIDE's value I can
> run an entire application with PySide2 or with PyQt5.
>
> But I'd really rather just have one lot of imports per file.
>
> One obvious solution is to create a 'Qt.py' module that imports everything
> depending on the PYSIDE switch and that I then use in all the other .py
> files, something like this:
>
> from Qt.QtCore import Qt
> from Qt.QtGui import QIcon
> ... etc.
>
> But I'm just wondering if there's a nicer way to do all this?
> --
> https://mail.python.org/mailman/listinfo/python-list


Check out pyqtgraph 

It tries to use  PyQt5/PyQt4/PySide depending on which if these packages
were imported before importing pyqtgraph.
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: Problem with assignment. Python error or mine?

[Tim Williams]

On Friday, December 22, 2017 at 8:41:29 AM UTC-5, Tim Williams wrote:
> On Thursday, December 21, 2017 at 12:18:11 PM UTC-5, MarkA wrote:
> > On Thu, 21 Dec 2017 07:05:33 -0800, rafaeltfreire wrote:
> > From docs.python.org:
> > 
> > 8.10. copy — Shallow and deep copy operations
> > 
> > Source code: Lib/copy.py
> > 
> > Assignment statements in Python do not copy objects, they create bindings 
> > between a target and an object. For collections that are mutable or 
> > contain mutable items, a copy is sometimes needed so one can change one 
> > copy without changing the other. This module provides generic shallow and 
> > deep copy operations (explained below)...
> > 
> > 
> > > Dear community, I am having the following problem when I am assigning
> > > the elements of a vector below a certain number to zero or any other
> > > value.
> > > I am creating a new variable but Python edits the root variable. Why?
> > > 
> > > import numpy as np
> > > 
> > > X=np.arange(1, 1, 1) #root variable x1=X x1[x1<1]=0
> > > 
> > > print(X)
> > > Out[1]: array([ 0.,  0.,  0., ...,  0.,  0.,  0.])
> > > 
> > > Why? It is supposed to be the original value Thank you for your
> > > time Rafael
> > 
> > 
> > 
> > -- 
> > MarkA
> > 
> > We hang petty theives, and appoint the great theives to public office
> >   -- Aesop
> 
> Shouldn't the OP just create a list for what he want's to do?
> 
> X = list(np.arange(1, 1, 1)) #root variable x1=X x1[x1<1]=0
> 
> Then I think his other statements would do what he expects, no?

Disregard what I just posted. I didn't think this through enough. 
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: Problem with assignment. Python error or mine?

[Tim Williams]

On Thursday, December 21, 2017 at 12:18:11 PM UTC-5, MarkA wrote:
> On Thu, 21 Dec 2017 07:05:33 -0800, rafaeltfreire wrote:
> From docs.python.org:
> 
> 8.10. copy — Shallow and deep copy operations
> 
> Source code: Lib/copy.py
> 
> Assignment statements in Python do not copy objects, they create bindings 
> between a target and an object. For collections that are mutable or 
> contain mutable items, a copy is sometimes needed so one can change one 
> copy without changing the other. This module provides generic shallow and 
> deep copy operations (explained below)...
> 
> 
> > Dear community, I am having the following problem when I am assigning
> > the elements of a vector below a certain number to zero or any other
> > value.
> > I am creating a new variable but Python edits the root variable. Why?
> > 
> > import numpy as np
> > 
> > X=np.arange(1, 1, 1) #root variable x1=X x1[x1<1]=0
> > 
> > print(X)
> > Out[1]: array([ 0.,  0.,  0., ...,  0.,  0.,  0.])
> > 
> > Why? It is supposed to be the original value Thank you for your
> > time Rafael
> 
> 
> 
> -- 
> MarkA
> 
> We hang petty theives, and appoint the great theives to public office
>   -- Aesop

Shouldn't the OP just create a list for what he want's to do?

X = list(np.arange(1, 1, 1)) #root variable x1=X x1[x1<1]=0

Then I think his other statements would do what he expects, no?
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: matplot plot hangs

[Tim Williams]

On Wednesday, November 1, 2017 at 6:30:27 PM UTC-4, Andrew Z wrote:
> nope. it doesnt:
> 
> I added print-s after each line and that produced:
> [az@hp src]$ cat ./main1.py
> import matplotlib.pyplot as plt
> print("imported")
> plt.plot([1,2,4,1])
> print("plot is done")
> plt.show()
> print("show is done")
> 
> [az@hp src]$ python3.5 ./main1.py
> imported
> ^C^Z
> [1]+  Stopped python3.5 ./main1.py
> 
> 
> On Wed, Nov 1, 2017 at 9:31 AM, Vlastimil Brom 
> wrote:
> 
> > 2017-11-01 13:49 GMT+01:00 Andrew Z :
> > > Wolfgang,
> > >  I tried to ran from ide with no rwsults, so now im trying from a
> > terminal
> > > in xwindow.
> > > The .plot is the last line in the script and it does hang trying to
> > execute
> > > it.
> > >
> > >
> > > On Nov 1, 2017 05:44, "Wolfgang Maier" <
> > > wolfgang.ma...@biologie.uni-freiburg.de> wrote:
> > >
> > > On 01.11.2017 00:40, Andrew Z wrote:
> > >
> > >> hello,
> > >>   learning python's plotting by using matplotlib with python35 on
> > fedora 24
> > >> x86.
> > >>
> > >> Installed matplotlib into user's directory.
> > >> tk, seemed to work -
> > >> http://www.tkdocs.com/tutorial/install.html#installlinux - the window
> > >> shows
> > >> up just fine.
> > >> but when trying to run the simple plot (
> > >> https://matplotlib.org/examples/pylab_examples/simple_plot.html) the
> > >> script
> > >> is hanging on;
> > >>
> > >> plt.plot(t, s)
> > >>
> > >> attempts to
> > >> matplotlib.interactive(True) didn't bring anything,
> > >>
> > >>
> > > Hi Andrew,
> > >
> > > From which environment are you trying to run the example? In the
> > terminal,
> > > from within some IDE, inside a jupyter notebook?
> > >
> > > Are you sure the script "is hanging on plt.plot(t, s)" and not after
> > that?
> > >
> > > Best,
> > > Wolfgang
> > >
> > > --
> > Hi,
> > sorry if it is too trivial, just to make sure, do you have a call to
> > "show()" the resulting plot in the code?
> >
> > An elementary plotting code might be e.g.:
> >
> > import matplotlib.pyplot as plt
> > plt.plot([1,2,4,1])
> > plt.show()
> >
> > Does this work in your environment?
> >
> > It was not quite clear, what do you plan with interactive drawing, or
> > whether you are using e.g. plt.interactive(True) already - this might
> > be a problem as there could be collisions or the plot window is closed
> > after the standalone script finishes.
> >
> > hth,
> >  vbr
> > --
> > https://mail.python.org/mailman/listinfo/python-list
> >

Have you tried 

plt.show(block=False)
?
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: using configobj string interpolation and logging.config.dictConfig

[Tim Williams]

On Friday, May 26, 2017 at 12:26:13 PM UTC-4, Peter Otten wrote:
> Tim Williams wrote:
> 
> > I've spent too much time trying to track this down. I'll just hard-code my
> > filename in my INI file. Maybe I'll get back to it, but I need to move on.
> 
> The only alternative I see would be to build your own InterpolationEngine 
> which understands some kind of escaping so that e. g.
> 
> format = '%%(asctime)s: (%%(levelname)s)  %%(message)s'
> 
> would become
> 
> format = '%(asctime)s: (%(levelname)s)  %(message)s'
> 
> when you invoke the dict() method.

It helps to sometimes just let a problem rest for awhile. I found a workaround 
to my problem. In my INI file, don't create a 'filename' key in the 
config['handlers']['file'] section. Set it in my python code after loading the 
INI file. The following works just fine for me. It doesn't address the issue of 
config.dict() string interpolating the format key, but it does what I want it 
to do and that's my bottom line.

Test script:

import logging, logging.config, logging.handlers
import configobj

logconfig = configobj.ConfigObj('loggingtest.ini', unrepr=True, 
raise_errors=True)

config=logconfig['loggng']
config['handlers']['file']['filename'] = logconfig['loggng']['LogFile']
logging.config.dictConfig(config)
formatters = config['formatters']['fmt1']
logger=logging.getLogger('root')
print(config['handlers']['file'])
for h in logger.handlers:
print('handler {}, stream {}'.format(h.name, h.stream))


loggingtest.ini:
###
[loggng]
version = 1
level = 'INFO'
RootDir = 'TestData'
CaptureDrive = 'C:/'
LogFile = '%(CaptureDrive)s%(RootDir)s/test.log'
[[formatters]]
[[[fmt1]]]
format = '%(asctime)s (%(levelname)s)  %(message)s'
datefmt =
[[handlers]]
[[[console]]]
class = 'logging.StreamHandler'
level = 'INFO'
#stream = 'ext://sys.stdout'
formatter = 'fmt1'
[[[file]]]
class = 'logging.FileHandler'
level = 'WARN'
formatter = 'fmt1'  
[[loggers]]
[[[root]]]
level = 'INFO'
handlers = ['file','console']
###
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: using configobj string interpolation and logging.config.dictConfig

[Tim Williams]

On Friday, May 26, 2017 at 8:37:38 AM UTC-4, Tim Williams wrote:
> On Friday, May 26, 2017 at 8:32:19 AM UTC-4, Tim Williams wrote:
> > On Thursday, May 25, 2017 at 9:43:40 PM UTC-4, Tim Williams wrote:
> > > On Thursday, May 25, 2017 at 5:16:13 PM UTC-4, Peter Otten wrote:
> > (snip)
> > > > ...
> > > > 
> > > > How do you get
> > > > 
> > > > > LogFile = '%(CaptureDrive)s%(RootDir)s/test.log'
> > > > 
> > > > to be interpolated while leaving
> > > > 
> > > > > format = '%(asctime)s: (%(levelname)s)  %(message)s'
> > > > 
> > > > as is?
> > > > 
> > > > > However, when I try to call logging.config.dictConfig() on it, the 
> > > > > stream
> > > > > that is opened on creating the logging.FileHandler object is
> > > > > "%(LogFile)s", not "C:/TestData/test.log".
> > > > 
> > > > I don't even get this far:
> > > > 
> > > > >>> c = configobj.ConfigObj("second.ini", unrepr=True)
> > > > >>> c.dict()
> > > > Traceback (most recent call last):
> > > > ...
> > > > configobj.MissingInterpolationOption: missing option "asctime" in 
> > > > interpolation.
> > > > 
> > > > I tried to escape % as %%, but that doesn't seem to work. When I 
> > > > provide 
> > > > bogus replacements
> > > > 
> > > > >>> c = configobj.ConfigObj("third.ini", unrepr=True)
> > > > >>> pprint.pprint(c.dict()["loggng"])
> > > > {'CaptureDrive': 'C:/',
> > > >  'LogFile': 'C:/TestData/test.log',
> > > >  'RootDir': 'TestData',
> > > >  'asctime': 'ASCTIME',
> > > >  'formatters': {'fmt1': {'datefmt': '',
> > > >  'format': 'ASCTIME: (LEVELNAME)  MESSAGE'}},
> > > >  'handlers': {'console': {'class': 'logging.StreamHandler',
> > > >   'level': 'INFO',
> > > >   'stream': 'ext://sys.stdout'},
> > > >   'file': {'class': 'logging.FileHandler',
> > > >'filename': 'C:/TestData/test.log',
> > > >'level': 'WARN'}},
> > > >  'level': 'INFO',
> > > >  'levelname': 'LEVELNAME',
> > > >  'loggers': {'root': {'handlers': ['file', 'console'], 'level': 
> > > > 'INFO'}},
> > > >  'message': 'MESSAGE',
> > > >  'version': 1}
> > > > 
> > > > I get the expected output.
> > > 
> > > I'm at home now, so I don't have my environment, but if I do a c.dict() I 
> > > get the error about asctime also. If I just pass in the dict object or do 
> > > a 'dict(config['loggng'])', I don't get that.
> > 
> > (Back at work.)
> > Looking at the non-interpolation of '%(asctime)s', etc again, I'm wondering 
> > that myself. Maybe this is a bug in configobj? That doesn't make sense 
> > though. I'm wondering if the keyword 'format' has something to do with it.
> 
> Changed key 'foramt' to 'formt'. No change on non-interpolation of 
> '%(asctime)s'

Peter,

I'm starting to think that maybe my problem is somewhere with configobj. 
Calling ConfigObj.dict() (really configobj.Section.dict()) tries to interpolate 
the values in the 'format' key, but not when creating the ConfigObj object, but 
it does interpolate the LogFile key value. 

I've spent too much time trying to track this down. I'll just hard-code my 
filename in my INI file. Maybe I'll get back to it, but I need to move on.

Thanks for your help.
Tim
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: using configobj string interpolation and logging.config.dictConfig

[Tim Williams]

On Friday, May 26, 2017 at 8:32:19 AM UTC-4, Tim Williams wrote:
> On Thursday, May 25, 2017 at 9:43:40 PM UTC-4, Tim Williams wrote:
> > On Thursday, May 25, 2017 at 5:16:13 PM UTC-4, Peter Otten wrote:
> (snip)
> > > ...
> > > 
> > > How do you get
> > > 
> > > > LogFile = '%(CaptureDrive)s%(RootDir)s/test.log'
> > > 
> > > to be interpolated while leaving
> > > 
> > > > format = '%(asctime)s: (%(levelname)s)  %(message)s'
> > > 
> > > as is?
> > > 
> > > > However, when I try to call logging.config.dictConfig() on it, the 
> > > > stream
> > > > that is opened on creating the logging.FileHandler object is
> > > > "%(LogFile)s", not "C:/TestData/test.log".
> > > 
> > > I don't even get this far:
> > > 
> > > >>> c = configobj.ConfigObj("second.ini", unrepr=True)
> > > >>> c.dict()
> > > Traceback (most recent call last):
> > > ...
> > > configobj.MissingInterpolationOption: missing option "asctime" in 
> > > interpolation.
> > > 
> > > I tried to escape % as %%, but that doesn't seem to work. When I provide 
> > > bogus replacements
> > > 
> > > >>> c = configobj.ConfigObj("third.ini", unrepr=True)
> > > >>> pprint.pprint(c.dict()["loggng"])
> > > {'CaptureDrive': 'C:/',
> > >  'LogFile': 'C:/TestData/test.log',
> > >  'RootDir': 'TestData',
> > >  'asctime': 'ASCTIME',
> > >  'formatters': {'fmt1': {'datefmt': '',
> > >  'format': 'ASCTIME: (LEVELNAME)  MESSAGE'}},
> > >  'handlers': {'console': {'class': 'logging.StreamHandler',
> > >   'level': 'INFO',
> > >   'stream': 'ext://sys.stdout'},
> > >   'file': {'class': 'logging.FileHandler',
> > >'filename': 'C:/TestData/test.log',
> > >'level': 'WARN'}},
> > >  'level': 'INFO',
> > >  'levelname': 'LEVELNAME',
> > >  'loggers': {'root': {'handlers': ['file', 'console'], 'level': 'INFO'}},
> > >  'message': 'MESSAGE',
> > >  'version': 1}
> > > 
> > > I get the expected output.
> > 
> > I'm at home now, so I don't have my environment, but if I do a c.dict() I 
> > get the error about asctime also. If I just pass in the dict object or do a 
> > 'dict(config['loggng'])', I don't get that.
> 
> (Back at work.)
> Looking at the non-interpolation of '%(asctime)s', etc again, I'm wondering 
> that myself. Maybe this is a bug in configobj? That doesn't make sense 
> though. I'm wondering if the keyword 'format' has something to do with it.

Changed key 'foramt' to 'formt'. No change on non-interpolation of 
'%(asctime)s'
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: using configobj string interpolation and logging.config.dictConfig

[Tim Williams]

On Thursday, May 25, 2017 at 9:43:40 PM UTC-4, Tim Williams wrote:
> On Thursday, May 25, 2017 at 5:16:13 PM UTC-4, Peter Otten wrote:
(snip)
> > ...
> > 
> > How do you get
> > 
> > > LogFile = '%(CaptureDrive)s%(RootDir)s/test.log'
> > 
> > to be interpolated while leaving
> > 
> > > format = '%(asctime)s: (%(levelname)s)  %(message)s'
> > 
> > as is?
> > 
> > > However, when I try to call logging.config.dictConfig() on it, the stream
> > > that is opened on creating the logging.FileHandler object is
> > > "%(LogFile)s", not "C:/TestData/test.log".
> > 
> > I don't even get this far:
> > 
> > >>> c = configobj.ConfigObj("second.ini", unrepr=True)
> > >>> c.dict()
> > Traceback (most recent call last):
> > ...
> > configobj.MissingInterpolationOption: missing option "asctime" in 
> > interpolation.
> > 
> > I tried to escape % as %%, but that doesn't seem to work. When I provide 
> > bogus replacements
> > 
> > >>> c = configobj.ConfigObj("third.ini", unrepr=True)
> > >>> pprint.pprint(c.dict()["loggng"])
> > {'CaptureDrive': 'C:/',
> >  'LogFile': 'C:/TestData/test.log',
> >  'RootDir': 'TestData',
> >  'asctime': 'ASCTIME',
> >  'formatters': {'fmt1': {'datefmt': '',
> >  'format': 'ASCTIME: (LEVELNAME)  MESSAGE'}},
> >  'handlers': {'console': {'class': 'logging.StreamHandler',
> >   'level': 'INFO',
> >   'stream': 'ext://sys.stdout'},
> >   'file': {'class': 'logging.FileHandler',
> >'filename': 'C:/TestData/test.log',
> >'level': 'WARN'}},
> >  'level': 'INFO',
> >  'levelname': 'LEVELNAME',
> >  'loggers': {'root': {'handlers': ['file', 'console'], 'level': 'INFO'}},
> >  'message': 'MESSAGE',
> >  'version': 1}
> > 
> > I get the expected output.
> 
> I'm at home now, so I don't have my environment, but if I do a c.dict() I get 
> the error about asctime also. If I just pass in the dict object or do a 
> 'dict(config['loggng'])', I don't get that.

(Back at work.)
Looking at the non-interpolation of '%(asctime)s', etc again, I'm wondering 
that myself. Maybe this is a bug in configobj? That doesn't make sense though. 
I'm wondering if the keyword 'format' has something to do with it.
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: using configobj string interpolation and logging.config.dictConfig

[Tim Williams]

On Thursday, May 25, 2017 at 5:16:13 PM UTC-4, Peter Otten wrote:
> Tim Williams wrote:
> 
> > On Wednesday, May 24, 2017 at 5:47:37 PM UTC-4, Peter Otten wrote:
> >> Tim Williams wrote:
> >> 
> >> > Just as a followup, if I use 'unrepr=True' in my ConfigObj, I don't
> >> > have to convert the strings.
> >> 
> >> I'd keep it simple and would use JSON...
> > 
> > I looked at JSON at first, but went with configobj because I didn't see
> > where it did string interpolation, which I needed for other parts of my
> > INI file, and I'm trying to use it to specify my log file in my handler.
> > 
> > Which brings me to ...
> 
> > I have this stripped down INI file:
> > 
> ...
> 
> How do you get
> 
> > LogFile = '%(CaptureDrive)s%(RootDir)s/test.log'
> 
> to be interpolated while leaving
> 
> > format = '%(asctime)s: (%(levelname)s)  %(message)s'
> 
> as is?
> 
> > However, when I try to call logging.config.dictConfig() on it, the stream
> > that is opened on creating the logging.FileHandler object is
> > "%(LogFile)s", not "C:/TestData/test.log".
> 
> I don't even get this far:
> 
> >>> c = configobj.ConfigObj("second.ini", unrepr=True)
> >>> c.dict()
> Traceback (most recent call last):
> ...
> configobj.MissingInterpolationOption: missing option "asctime" in 
> interpolation.
> 
> I tried to escape % as %%, but that doesn't seem to work. When I provide 
> bogus replacements
> 
> >>> c = configobj.ConfigObj("third.ini", unrepr=True)
> >>> pprint.pprint(c.dict()["loggng"])
> {'CaptureDrive': 'C:/',
>  'LogFile': 'C:/TestData/test.log',
>  'RootDir': 'TestData',
>  'asctime': 'ASCTIME',
>  'formatters': {'fmt1': {'datefmt': '',
>  'format': 'ASCTIME: (LEVELNAME)  MESSAGE'}},
>  'handlers': {'console': {'class': 'logging.StreamHandler',
>   'level': 'INFO',
>   'stream': 'ext://sys.stdout'},
>   'file': {'class': 'logging.FileHandler',
>'filename': 'C:/TestData/test.log',
>'level': 'WARN'}},
>  'level': 'INFO',
>  'levelname': 'LEVELNAME',
>  'loggers': {'root': {'handlers': ['file', 'console'], 'level': 'INFO'}},
>  'message': 'MESSAGE',
>  'version': 1}
> 
> I get the expected output.

I'm at home now, so I don't have my environment, but if I do a c.dict() I get 
the error about asctime also. If I just pass in the dict object or do a 
'dict(config['loggng'])', I don't get that.
-- 
https://mail.python.org/mailman/listinfo/python-list

using configobj string interpolation and logging.config.dictConfig (was Re: dictConfig: logging.StreamHandler object is not iterable.)

[Tim Williams]

On Wednesday, May 24, 2017 at 5:47:37 PM UTC-4, Peter Otten wrote:
> Tim Williams wrote:
> 
> > Just as a followup, if I use 'unrepr=True' in my ConfigObj, I don't have
> > to convert the strings.
> 
> I'd keep it simple and would use JSON...

I looked at JSON at first, but went with configobj because I didn't see where 
it did string interpolation, which I needed for other parts of my INI file, and 
I'm trying to use it to specify my log file in my handler.

Which brings me to ...

I have this stripped down INI file:

[loggng]
version = 1
level = 'INFO'
RootDir = 'TestData'
CaptureDrive = 'C:/'
LogFile = '%(CaptureDrive)s%(RootDir)s/test.log'
[[formatters]]
[[[fmt1]]]
format = '%(asctime)s: (%(levelname)s)  %(message)s'
datefmt =
[[handlers]]
[[[console]]]
class = 'logging.StreamHandler'
level = 'INFO'
stream = 'ext://sys.stdout'
[[[file]]]
class = 'logging.FileHandler'
level = 'WARN'
filename = '%(LogFile)s'
#filename = 'cfg://loggng.LogFile'
[[loggers]]
[[[root]]]
level = 'INFO'
handlers = ['file','console']

When I parse the INI file with configobj:
config = configobj.ConfigObj('loggingtest.ini', unrepr=True, raise_errors=True)

config['loggng']['handlers']['file']['filename'] evaluates correctly to 
C:/TestData/test.log

However, when I try to call logging.config.dictConfig() on it, the stream that 
is opened on creating the logging.FileHandler object is "%(LogFile)s", not 
"C:/TestData/test.log".

Stepping into the debugger, I see that the dictionary is changed in 
BaseConfigurator.convert()

def convert(self, value):
"""
Convert values to an appropriate type. dicts, lists and tuples are
replaced by their converting alternatives. Strings are checked to
see if they have a conversion format and are converted if they do.
"""
if not isinstance(value, ConvertingDict) and isinstance(value, dict):
value = ConvertingDict(value)
value.configurator = self

BEFORE calling ConvertingDict(value), the value dict has the correct value for 
key filename:

>>> value
{'class': 'logging.FileHandler', 'level': 'WARN', 'filename': 
'C:/TestData/test.log'}

AFTER calling ConvertingDict(value):

>>> value
{'filename': '%(LogFile)s', 'class': 'logging.FileHandler', 'level': 'WARN'}

If I try to use 
filename = 'cfg://loggng.LogFile'
in my INI file, I get a ValueError calling logging.config.dictConfig(config):


pydev debugger: starting (pid: 70744)
Traceback (most recent call last):
  File "C:\Python34\lib\logging\config.py", line 557, in configure
handler = self.configure_handler(handlers[name])
  File "C:\Python34\lib\logging\config.py", line 723, in configure_handler
kwargs = dict([(k, config[k]) for k in config if valid_ident(k)])
  File "C:\Python34\lib\logging\config.py", line 723, in 
kwargs = dict([(k, config[k]) for k in config if valid_ident(k)])
  File "C:\Python34\lib\logging\config.py", line 318, in __getitem__
return self.convert_with_key(key, value)
  File "C:\Python34\lib\logging\config.py", line 284, in convert_with_key
result = self.configurator.convert(value)
  File "C:\Python34\lib\logging\config.py", line 455, in convert
value = converter(suffix)
  File "C:\Python34\lib\logging\config.py", line 404, in cfg_convert
d = self.config[m.groups()[0]]
  File "C:\Python34\lib\logging\config.py", line 317, in __getitem__
value = dict.__getitem__(self, key)
KeyError: 'loggng'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "L:\timothy.j.williams1\Documents\My 
Programs\eclipse_neon\eclipse\plugins\org.python.pydev_5.3.0.201610121612\pysrc\pydevd.py",
 line 1531, in 
globals = debugger.run(setup['file'], None, None, is_module)
  File "L:\timothy.j.williams1\Documents\My 
Programs\eclipse_neon\eclipse\plugins\org.python.pydev_5.3.0.201610121612\pysrc\pydevd.py",
 line 938, in run
pydev_imports.execfile(file, globals, locals)  # execute the script
  File "L:\timothy.j.williams1\Documents\My 
Programs\eclip

Re: dictConfig: logging.StreamHandler object is not iterable.

[Tim Williams]

On Wednesday, May 24, 2017 at 2:46:54 PM UTC-4, Tim Williams wrote:
> (Apologies for using Google Groups to post)
> 
> I'm trying to use dictConfig to configure logging. I keep running into the 
> error that the logging.StreamHandler object is not iterable.
> 
> I'm using Python 3.4.3 on a Windows 7 box.
> 
> C:\Python34\python.exe 3.4.3 (v3.4.3:9b73f1c3e601, Feb 24 2015, 22:44:40) 
> [MSC v.1600 64 bit (AMD64)]
> 
> 
> I want to use the configobj module to create the dictionary from an INI file, 
> but that's not the problem I'm having. 
> 
> Here is my test code:
> #
> import logging, logging.config, logging.handlers
> import configobj
> 
> # config = configobj.ConfigObj('loggingtest.ini')
> # config['version']=eval(config['version'])
> config = {
>   'version': 1, 
>   'level': 'INFO',
>   'formatters': {'fmt1': {'format': '%(asctime)s: (%(levelname)s)  
> %(message)s', 
>   'datefmt': ''}
>  }, 
>   'loggers': {'root': {'level': 'INFO', 
>'handlers': 'cfg://handlers.console'}, 
>   'file': {'level': 'WARN', 
>'handlers': 'cfg://handlers.file'}
>   }, 
>   'handlers': {'console': {'class': 'logging.StreamHandler', 
>'level': 'INFO', 
>'stream': 'ext://sys.stdout'}, 
>'file': {'class': 'logging.FileHandler', 
> 'level': 'WARN', 
> 'filename': 'test.log'}
>}, 
>   }
> 
> 
> logging.config.dictConfig(config)
> 
> 
> When I run it, I get this traceback:
> 
> Traceback (most recent call last):
>   File "C:\Python34\lib\logging\config.py", line 611, in configure
> self.configure_logger(name, loggers[name])
>   File "C:\Python34\lib\logging\config.py", line 775, in configure_logger
> self.common_logger_config(logger, config, incremental)
>   File "C:\Python34\lib\logging\config.py", line 767, in common_logger_config
> self.add_handlers(logger, handlers)
>   File "C:\Python34\lib\logging\config.py", line 748, in add_handlers
> for h in handlers:
> TypeError: 'StreamHandler' object is not iterable
> 
> During handling of the above exception, another exception occurred:
> 
> Traceback (most recent call last):
>   File "L:\workspace\MyPython\src\testlog.py", line 27, in 
> logging.config.dictConfig(config)
>   File "C:\Python34\lib\logging\config.py", line 789, in dictConfig
> dictConfigClass(config).configure()
>   File "C:\Python34\lib\logging\config.py", line 614, in configure
> '%r: %s' % (name, e))
> ValueError: Unable to configure logger 'root': 'StreamHandler' object is not 
> iterable
> 
> 
> I even tried creating a JSON file to create the dictionary, and got the same 
> error.
> 
> Thanks for any help
> --
> Tim

Just as a followup, if I use 'unrepr=True' in my ConfigObj, I don't have to 
convert the strings.
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: dictConfig: logging.StreamHandler object is not iterable.

[Tim Williams]

On Wednesday, May 24, 2017 at 2:46:54 PM UTC-4, Tim Williams wrote:
> (Apologies for using Google Groups to post)
> 
> I'm trying to use dictConfig to configure logging. I keep running into the 
> error that the logging.StreamHandler object is not iterable.
> 
> I'm using Python 3.4.3 on a Windows 7 box.
> 
> C:\Python34\python.exe 3.4.3 (v3.4.3:9b73f1c3e601, Feb 24 2015, 22:44:40) 
> [MSC v.1600 64 bit (AMD64)]
> 
> 
> I want to use the configobj module to create the dictionary from an INI file, 
> but that's not the problem I'm having. 
> 
> Here is my test code:
> #
> import logging, logging.config, logging.handlers
> import configobj
> 
> # config = configobj.ConfigObj('loggingtest.ini')
> # config['version']=eval(config['version'])
> config = {
>   'version': 1, 
>   'level': 'INFO',
>   'formatters': {'fmt1': {'format': '%(asctime)s: (%(levelname)s)  
> %(message)s', 
>   'datefmt': ''}
>  }, 
>   'loggers': {'root': {'level': 'INFO', 
>'handlers': 'cfg://handlers.console'}, 
>   'file': {'level': 'WARN', 
>'handlers': 'cfg://handlers.file'}
>   }, 
>   'handlers': {'console': {'class': 'logging.StreamHandler', 
>'level': 'INFO', 
>'stream': 'ext://sys.stdout'}, 
>'file': {'class': 'logging.FileHandler', 
> 'level': 'WARN', 
> 'filename': 'test.log'}
>}, 
>   }
> 
> 
> logging.config.dictConfig(config)
> 
> 
> When I run it, I get this traceback:
> 
> Traceback (most recent call last):
>   File "C:\Python34\lib\logging\config.py", line 611, in configure
> self.configure_logger(name, loggers[name])
>   File "C:\Python34\lib\logging\config.py", line 775, in configure_logger
> self.common_logger_config(logger, config, incremental)
>   File "C:\Python34\lib\logging\config.py", line 767, in common_logger_config
> self.add_handlers(logger, handlers)
>   File "C:\Python34\lib\logging\config.py", line 748, in add_handlers
> for h in handlers:
> TypeError: 'StreamHandler' object is not iterable
> 
> During handling of the above exception, another exception occurred:
> 
> Traceback (most recent call last):
>   File "L:\workspace\MyPython\src\testlog.py", line 27, in 
> logging.config.dictConfig(config)
>   File "C:\Python34\lib\logging\config.py", line 789, in dictConfig
> dictConfigClass(config).configure()
>   File "C:\Python34\lib\logging\config.py", line 614, in configure
> '%r: %s' % (name, e))
> ValueError: Unable to configure logger 'root': 'StreamHandler' object is not 
> iterable
> 
> 
> I even tried creating a JSON file to create the dictionary, and got the same 
> error.
> 
> Thanks for any help
> --
> Tim

Peter,

Thanks. That did it for my dictionary.
What I'm really trying to do is use configobj to do this from an INI file. The 
one problem is that all the values are strings, hence the 

config['version']=eval(config['version'])

It looks like if I do something similar with the handlers in the loggers, like:

config['loggers']['root']['handlers']=eval(config['loggers']['root']['handlers'])
config['loggers']['file']['handlers']=eval(config['loggers']['file']['handlers'])

logging.config.dictConfig(dict(config))

seems to work.

I'm using configobj instead of configparser because configobj can nest 
sections. The INI file I'm trying to build has more sections for other things.

version = 1
level = INFO
[formatters]
[[fmt1]]
format = "%(asctime)s: (%(levelname)s)  %(message)s"
datefmt =
[handlers]
[[console]]
class = logging.StreamHandler
level = INFO
stream = ext://sys.stdout
[[file]]
class = logging.FileHandler
level = WARN
filename = test.log
[loggers]
[[root]]
level = INFO
handlers = [console]
[[file]]
level = WARN
handlers = ['file']
propagate = 1

-- 
https://mail.python.org/mailman/listinfo/python-list

dictConfig: logging.StreamHandler object is not iterable.

[Tim Williams]

(Apologies for using Google Groups to post)

I'm trying to use dictConfig to configure logging. I keep running into the 
error that the logging.StreamHandler object is not iterable.

I'm using Python 3.4.3 on a Windows 7 box.

C:\Python34\python.exe 3.4.3 (v3.4.3:9b73f1c3e601, Feb 24 2015, 22:44:40) [MSC 
v.1600 64 bit (AMD64)]


I want to use the configobj module to create the dictionary from an INI file, 
but that's not the problem I'm having. 

Here is my test code:
#
import logging, logging.config, logging.handlers
import configobj

# config = configobj.ConfigObj('loggingtest.ini')
# config['version']=eval(config['version'])
config = {
  'version': 1, 
  'level': 'INFO',
  'formatters': {'fmt1': {'format': '%(asctime)s: (%(levelname)s)  
%(message)s', 
  'datefmt': ''}
 }, 
  'loggers': {'root': {'level': 'INFO', 
   'handlers': 'cfg://handlers.console'}, 
  'file': {'level': 'WARN', 
   'handlers': 'cfg://handlers.file'}
  }, 
  'handlers': {'console': {'class': 'logging.StreamHandler', 
   'level': 'INFO', 
   'stream': 'ext://sys.stdout'}, 
   'file': {'class': 'logging.FileHandler', 
'level': 'WARN', 
'filename': 'test.log'}
   }, 
  }


logging.config.dictConfig(config)


When I run it, I get this traceback:

Traceback (most recent call last):
  File "C:\Python34\lib\logging\config.py", line 611, in configure
self.configure_logger(name, loggers[name])
  File "C:\Python34\lib\logging\config.py", line 775, in configure_logger
self.common_logger_config(logger, config, incremental)
  File "C:\Python34\lib\logging\config.py", line 767, in common_logger_config
self.add_handlers(logger, handlers)
  File "C:\Python34\lib\logging\config.py", line 748, in add_handlers
for h in handlers:
TypeError: 'StreamHandler' object is not iterable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "L:\workspace\MyPython\src\testlog.py", line 27, in 
logging.config.dictConfig(config)
  File "C:\Python34\lib\logging\config.py", line 789, in dictConfig
dictConfigClass(config).configure()
  File "C:\Python34\lib\logging\config.py", line 614, in configure
'%r: %s' % (name, e))
ValueError: Unable to configure logger 'root': 'StreamHandler' object is not 
iterable


I even tried creating a JSON file to create the dictionary, and got the same 
error.

Thanks for any help
--
Tim
-- 
https://mail.python.org/mailman/listinfo/python-list

Re: numpy array operation

[Tim Williams]

On Tuesday, January 29, 2013 3:41:54 AM UTC-5, C. Ng wrote:
> Is there a numpy operation that does the following to the array?
> 
> 
> 
> 1 2  ==>  4 3
> 
> 3 4   2 1
> 
> 
> 
> Thanks in advance.

>>> import numpy as np
>>> a=np.array([[1,2],[3,4]])
>>> a
array([[1, 2],
   [3, 4]])
>>> np.fliplr(np.flipud(a))
array([[4, 3],
   [2, 1]])

-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Accessing dll

[Tim Williams]

On Thursday, September 6, 2012 4:21:56 PM UTC-4, Tim Williams wrote:
> On Thursday, September 6, 2012 11:07:07 AM UTC-4, Helpful person wrote:
> 
> > I am a complete novice to Python.  I wish to access a dll that has
> 
> > 
> 
> > been written to be compatible with C and VB6.  I have been told that
> 
> > 
> 
> > after running Python I should enter  "from ctypes import *" which
> 
> > 
> 
> > allows Python to recognize the dll structure.  I have placed the dll
> 
> > 
> 
> > into my active directory (if that's the correct word, one on my path)
> 
> > 
> 
> > for simplification.
> 
> > 
> 
> > 
> 
> > 
> 
> > I tried:   "import name.dll" but this just gave me an error telling me
> 
> > 
> 
> > that there was no such module.
> 
> > 
> 
> > 
> 
> > 
> 
> > Can someone please help?
> 
> > 
> 
> > 
> 
> > 
> 
> > Richard
> 
> 
> 
> I'm new to using the ctypes module also, but what I did to find the library 
> was I appended the location of the dll to my PATH like so: (this is Windows)
> 
> 
> 
> pth = os.environ['path'].split(';')
> 
> pth.append(os.path.join(os.environ['userprofile'],'My Documents','DLLs'))
> 
> os.environ['path'] = ';'.join(pth)

I should have also mentioned to look at LoadLibrary in the ctypes module. e.g. 

mylib=cdll.LoadLibrary('mylib.dll')
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Accessing dll

[Tim Williams]

On Thursday, September 6, 2012 11:07:07 AM UTC-4, Helpful person wrote:
> I am a complete novice to Python.  I wish to access a dll that has
> 
> been written to be compatible with C and VB6.  I have been told that
> 
> after running Python I should enter  "from ctypes import *" which
> 
> allows Python to recognize the dll structure.  I have placed the dll
> 
> into my active directory (if that's the correct word, one on my path)
> 
> for simplification.
> 
> 
> 
> I tried:   "import name.dll" but this just gave me an error telling me
> 
> that there was no such module.
> 
> 
> 
> Can someone please help?
> 
> 
> 
> Richard

I'm new to using the ctypes module also, but what I did to find the library was 
I appended the location of the dll to my PATH like so: (this is Windows)

pth = os.environ['path'].split(';')
pth.append(os.path.join(os.environ['userprofile'],'My Documents','DLLs'))
os.environ['path'] = ';'.join(pth)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: calling loaded DLL function expecting POINT * argument

[Tim Williams]

On Tuesday, September 4, 2012 8:16:33 AM UTC-4, Tim Williams wrote:
> On Sunday, August 26, 2012 9:23:49 PM UTC-4, Tim Roberts wrote:
> 
> > Tim Williams  wrote:
> 
> > 
> 
> > 
> 
> > 
> 
> > >Hello all,
> 
> > 
> 
> > >
> 
> > 
> 
> > >I'm trying to use the ctypes module to call functions in a DLL. I've
> 
> > 
> 
> > >figured out how to modify my path so the library is found, and I can 
> 
> > 
> 
> > >call LoadLibrary on it, but one of the functions expects an array of
> 
> > 
> 
> > > POINTS. Here is the prototype from the .h file:
> 
> > 
> 
> > >
> 
> > 
> 
> > >
> 
> > 
> 
> > >TRACKER_API HRESULT InitializeMask(HANDLE pHandle, int nWidth, int 
> > >nHeight, POINT* ptMasks, int nNumPoints);
> 
> > 
> 
> > 
> 
> > 
> 
> > How is TRACKER_API defined?  You're using ctypes.oledll, which uses the
> 
> > 
> 
> > __stdcall calling convention.  It's possible your DLL is defined as
> 
> > 
> 
> > __cdecl.  Try cdll.LoadLibrary instead of oledll.LoadLibrary.
> 
> > 
> 
> > -- 
> 
> > 
> 
> > Tim Roberts, t...@probo.com
> 
> > 
> 
> > Providenza & Boekelheide, Inc.
> 
> 
> 
> Thanks for the reply. I've been out all last week. I'll give it a try.

cdll.LoadLibrary did trick! Thanks again. Now on to the next step
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: calling loaded DLL function expecting POINT * argument

[Tim Williams]

On Sunday, August 26, 2012 9:23:49 PM UTC-4, Tim Roberts wrote:
> Tim Williams  wrote:
> 
> 
> 
> >Hello all,
> 
> >
> 
> >I'm trying to use the ctypes module to call functions in a DLL. I've
> 
> >figured out how to modify my path so the library is found, and I can 
> 
> >call LoadLibrary on it, but one of the functions expects an array of
> 
> > POINTS. Here is the prototype from the .h file:
> 
> >
> 
> >
> 
> >TRACKER_API HRESULT InitializeMask(HANDLE pHandle, int nWidth, int nHeight, 
> >POINT* ptMasks, int nNumPoints);
> 
> 
> 
> How is TRACKER_API defined?  You're using ctypes.oledll, which uses the
> 
> __stdcall calling convention.  It's possible your DLL is defined as
> 
> __cdecl.  Try cdll.LoadLibrary instead of oledll.LoadLibrary.
> 
> -- 
> 
> Tim Roberts, t...@probo.com
> 
> Providenza & Boekelheide, Inc.

Thanks for the reply. I've been out all last week. I'll give it a try.
-- 
http://mail.python.org/mailman/listinfo/python-list

calling loaded DLL function expecting POINT * argument

[Tim Williams]

Hello all,

I'm trying to use the ctypes module to call functions in a DLL. I've figured 
out how to modify my path so the library is found, and I can call LoadLibrary 
on it, but one of the functions expects an array of POINTS. Here is the 
prototype from the .h file:


TRACKER_API HRESULT InitializeMask(HANDLE pHandle, int nWidth, int nHeight, 
POINT* ptMasks, int nNumPoints);

I did a 

from ctypes.wintypes import *

Here's my test script:
##
'''
Created on Aug 23, 2012

@author: williams
'''
import os
import numpy as np
import scipy.io
from ctypes import *
from ctypes.wintypes import *


matdata = 
scipy.io.loadmat(os.path.join(os.environ['userprofile'],'Desktop','S31_f1.mat'))
data = matdata['data']
nHeight,nWidth = data.shape

pth = os.environ['path'].split(';')
pth.append(os.path.join(os.environ['userprofile'],'My Documents','DLLs'))
os.environ['path'] = ';'.join(pth)
tck=oledll.LoadLibrary('Tracker')
hTrkr = tck.CreateTracker()
maskImage = np.zeros((1024,1280),dtype='int32')
maskImage[300:305,100:105] = True
idx = np.array(maskImage.nonzero())
nPoint = idx.shape[1]

ptMaskType = nPoint * POINT
pts = zip(idx[1,:],idx[0,:])
ptMasks = ptMaskType(*pts)

tck.InitializeMask.argtypes=(HANDLE, c_int, c_int, c_void_p, c_int)
InitMaskResult = tck.InitializeMask(hTrkr, nWidth, nHeight, ptMasks, nPoint)

if __name__ == '__main__':
pass
##

so I have the POINT class, and I've created the array of POINTs. When I try to 
call this function, I get this message:

>>> InitMaskResult = tck.InitializeMask(hTrkr, nWidth, nHeight, ptMasks, nPoint)
Traceback (most recent call last):
  File "", line 1, in 
ValueError: Procedure probably called with too many arguments (20 bytes in 
excess)


This is the first time that I've tried to use the ctypes module, so any help is 
appreciated.

TIA,
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: problem loading matlab data with ompc and python

[Tim Williams]

On May 23, 5:10 pm, no1  wrote:
> Hi, we're investigating transitioning our company from matlab to python. We 
> found OMPC as a MATLAB m-file-to Python translator, but we're encountering a 
> problem using the translated code to import MATLAB data structures into 
> Python. For example, when we save data within MATLAB this way:
>
> x.a = 5;
> x.b = 6;
> save -v6 test x
>
> this saves data in test.mat, with MATLAB version 6 compatibility (OMPC says 
> it's not compatible with the latest versions of MATLAB). The code to read in 
> data in MATLAB is just
>
> load test
>
> and when we run it through OMPC we get
>
> load(mstring('test.mat'))
>
> but when we run it we get the error message
>
> File "ompclib\ompclib_numpy.py", line 1496, in load
> KeyError: "[('a', '|O4'), ('b', '|O4')]"
>
> Reading in simpler data (up to arrays) does not have this problem.
>
> To get other people in the company to transition, we were hoping that the 
> translation process could be done in one step or on the fly. We could read in 
> MATLAB data using I/O functions imported from scipy, but then the transition 
> isn't seamless any more.
>
> Is there a simple fix to using OMPC? Or a similar alternative that would work 
> better?
>
> Thanks

Have you tried using loadmat from the scipy.io module?

http://docs.scipy.org/doc/scipy/reference/io.html
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Accessing the files by last modified time

[Tim Williams]

On Mar 22, 7:33 am, Sangeet  wrote:
> Hi
>
> I am new to the python programming language.
>
> I've been trying to write a script that would access the last modified file 
> in one of my directories. I'm using Win XP.
>
> I saw a similar topic, on the forum before, however the reply using 
> (os.popen) didn't work out for me. I'm not sure whether it was due to syntax 
> errors either.
>
> Thanks,
> Sangeet

Check out os.stat()
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Read time and date from a text file

[Tim Williams]

On Nov 24, 7:45 am, huisky  wrote:
> Hi,
>
> As a newbie, I posted my question here again.
> say i have two dics read from a text file by 'split'.
>
> >>> cstart
>
> defaultdict(, {15424: ['Dec', '6', '18:57:40'], 552:
> ['Dec', '7', '09:31:00'], 15500: ['Dec', '6', '20:17:02'], 18863:
> ['Dec', '7', '13:14:47'], 18291: ['Dec', '6', '21:01:17'], 18969:
> ['Dec', '7', '14:28:42'], 18937: ['Dec', '7', '14:21:34']})
>
> >>> ccompl
>
> defaultdict(, {15424: ['Dec', '6', '19:42:55'], 18291:
> ['Dec', '6', '21:01:28'], 15500: ['Dec', '6', '20:26:03'], 18863:
> ['Dec', '7', '13:24:07']})
>
> and I need to calculate the difference time if the key value is the
> same in both dics.
>
> Someone suggested me to use the module 'datetime', but I'm still
> wondering how to make it work.
> I mean how to assign ['Dec','6','21:01:17'] to a 'datetime' object and
> then do the datetime operation.
>
> >>>time=datetime.datetime(cstart[18291])       does NOT work.
>
> thanks in advance
> Huisky

You can use datetime.datetime.strptime() to create a datetime object
from a string representing a date


>>> import datetime
>>> datetime.datetime.strptime('Dec 7  13:24:07','%b %d %H:%M:%S')
datetime.datetime(1900, 12, 7, 13, 24, 7)

Of course, you need to put in the correct year.

datetime.strptime(date_string, format)
Return a datetime corresponding to date_string, parsed according to
format. This is equivalent to datetime(*(time.strptime(date_string,
format)[0:6])). ValueError is raised if the date_string and format
can’t be parsed by time.strptime() or if it returns a value which
isn’t a time tuple.

-- 
http://mail.python.org/mailman/listinfo/python-list

Re: smtplib problem, Unable to relay for

[Tim Williams]

On 21/12/2007, Benedict Verheyen <[EMAIL PROTECTED]> wrote:
> Hi,
>
> i get an "Unable to relay for" when trying to send an email from within
> my network to an email address not on my domain.
> I don't understand why it says "relaying" as i'm sending from an
> internal domain user to an external user.
> Email server is exchange 2003
>
> See this trace
>
>  >>> smtp.sendmail("[EMAIL PROTECTED]", ["[EMAIL PROTECTED]"], msg)
> Traceback (most recent call last):
>   File "", line 1, in 
>   File "C:\Python25\Lib\smtplib.py", line 695, in sendmail
> raise SMTPRecipientsRefused(senderrs)
> smtplib.SMTPRecipientsRefused: {'[EMAIL PROTECTED]': (550, '5.7.1
> Unable to relay for [EMAIL PROTECTED]')}
>
> The smpt var is this:
> smtp = smtplib.SMTP(server) where server is my mail server
>
> I can mail to any user that is part of mydomain.be but as soon as i try
> an external address, i get the "Unable to relay" message.
>
> With a mail program it works but i need to be able to do it via code.
> I thought that i would have to authenticate (smtp.login) to our mail
> server but that didn't resolve the issue
>
> Any idea how i could do this?

Have you asked your Exchange admin if the server is allowed to relay via SMTP?

The Exchange server is returning a valid response so it's most likely
that it is just not configured to relay (via SMTP).

If your "working mail program" is Outlook then it is using MAPI not
SMTP to send/receive email.

If your "working mail program" is an SMTP email client, or you have
added a POP3/IMAP & SMTP account to your Outlook, then something
strange is happening and relaying is probably allowed. You would need
to talk to your exchange admin to see what's shown in the server logs
for your failed SMTPLIB attempts.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Pulling data from a .asps site

[Tim Williams]

On 27/11/2007, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> There's a government website which shows public data for banks. We'd
> like to pull the data down programmatically but the data is "hidden"
> behind .aspx...
>
> Is there anyway in Python to hook in directly to a browser (firefox or
> IE) to do the following...
>
> 1) Fill the search criteria
> 2) Press the "Search" button
> 3) Press another button (the CSV button) on the resulting page
> 4) Then grab the data out of the notepad file that pops up
>
> If this is a wild good chase, let me know... (or if there's a better
> way besides Python... I may have to explore writing a firefox plug-in
> or something)...

Amongst others, IEC will allow you to open an IE browser window,
navigate around sites (including pushing buttons), and retrieve text.

http://www.mayukhbose.com/python/IEC/index.php

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: local variable referenced before assignment

[Tim Williams]

On 25/10/2007, A.T.Hofkamp <[EMAIL PROTECTED]> wrote:
> On 2007-10-25, Pete Bartonly <[EMAIL PROTECTED]> wrote:
> >
> Also, brackets around conditions (in the if) are not needed, and comparing
> against None is usually done with 'is' or 'is not' instead of '==' or '!='.
> The result is then
>
> if logMsg is not None:

Or just

>>>  if logMsg:
do_something()

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: test if email

[Tim Williams]

On 12/10/2007, brad <[EMAIL PROTECTED]> wrote:
> Florian Lindner wrote:
> > Hello,
> > is there a function in the Python stdlib to test if a string is a valid
> > email address?
>
> Nope, most any string with an @ in it could be a valid email addy. Send
> a message to the addy, if it doesn't bounce, then it's valid.

Invalid email doesn't always bounce, ( or the bounces may not always reach you )

:)

-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: test if email

[Tim Williams]

On 12/10/2007, Florian Lindner <[EMAIL PROTECTED]> wrote:
> Hello,
> is there a function in the Python stdlib to test if a string is a valid
> email address?
>

You mean a valid SMTP email address?

In reality, there isn't a way of doing this.  But a good rule of thumb
is if it hasn't got at least one '@' symbol with at least one '.' to
the right of the right-most '@' symbol then it isn't valid for
internet transmission.

If you meant "test if a string is an existing email address",  then
again there is no foolproof way of testing.   Valid email addresses
can bounce for a variety of reasons, and invalid email addresses don't
always bounce.  Using an SMTP dialogue with the server without sending
an email can have the same bounce/non-bounce (actually, accept/refuse)
results.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Finding Peoples' Names in Files

[Tim Williams]

On 11/10/2007, brad <[EMAIL PROTECTED]> wrote:
> Crazy question, but has anyone attempted this or seen Python code that
> does? For example, if a text file contained 'Guido' and or 'Robert' and
> or 'Susan', then we should return True, otherwise return False.
> --
> http://mail.python.org/mailman/listinfo/python-list
>


Text = open(fname).read()

def a_function():
for Name in ['Guido', Robert',Susan']:
   if Name in Text:
   return 1

if a_function():
print "A name was found"

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Editing particular lines of a text file.

[Tim Williams]

On 09/10/2007, Shriphani <[EMAIL PROTECTED]> wrote:
> Hello all,
>
> I am trying to create a script that looks at specific strings in a
> file like:
>
> msgid "I am a disco dancer."
>
> and compares the part in quotes to the keys in a dictionary, finds the
> value and creates a new line right after this string in the file. I
> have planned to write this as follows:
>
> 1. Open the file in read mode
> 2. parse each line to figure out which line contains "msgid" and use
> the shlex module's split method to go and split this line and pick the
> 2nd element list[1].
> 3. find the value from the dictionary corresponding to the above
> element.
> 4. Insert the line. This part is where I face a problem. How do I
> plainly edit just one line. I would also like to look at some sample
> code that does this.
> 5. open a new file and write the new file with the inserted strings to
> it.
> 6. close both files opened.


infile = open('infile.txt')
outfile = open('outfile.txt','w')
for line in infile:
if 'msgid' in line:
 #  transform line
 #  make sure the line ending is intact
outfile.write(line)
infile.close()
outfile.close()

or maybe

infile = open('infile.txt')
outfile = open('outfile.txt','w')
new_file = []
for line in infile:
if 'msgid' in line:
 #  transform line
 #  make sure the line ending is intact
new_file.append(line)
outfile.write(''.join(new_file)
infile.close()
outfile.close()




-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Putting a line from a text file into a variable, then moving to next line

[Tim Williams]

On 07/10/2007, Tim Chase <[EMAIL PROTECTED]> wrote:
> > I'm not really sure how readline() works. Is there a way to iterate
> > through a file with multiple lines and then putting each line in a
> > variable in a loop?
>
> You can use readlines() to get the whole line (including the
> newline):
>
>  lines = file('x.txt').readlines()
>
> or you can iterate over the file building a list without the newline:
>
>  lines = [line.rstrip('\n') for line in file('x.txt')]
>
> Thus, line[0] will be the first line in your file, line[1] will
> be the second, etc.
>

or splitlines()
>>>  lines = open('x.txt').read().splitlines()

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: List search

[Tim Williams]

On 28/09/2007, Kevin Walzer <[EMAIL PROTECTED]> wrote:
> I'm having a problem with searching a list. Here's my code:
>
> mylist = ['x11', 'x11-wm', 'x11-system']
>
> for line in mylist:
>if 'x11' in line:
>print line
>
> This results in the following output:
>
> x11
> x11-wm
> x11-system
>

That output is correct,  you are asking your script to print any list
item containing x11 when what you actually wanted was a list item that
is the string 'x11'

mylist = ['x11', 'x11-wm', 'x11-system']
for item in mylist:
  if item ==  'x11':
   print line

If there is only ever one 'x11' in the list you could also consider

print mylist.index('x11')

and

print mylist[mylist.index('x11')]

Also, before iterating the whole list check that 'x11' exists

if 'x11' in mylist:
do stuff

and list comprehesions

print [x for x in mylist if x == 'x11']

HTH :)

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: recipient validation with smtplib

[Tim Williams]

On 28/09/2007, Robin Becker <[EMAIL PROTECTED]> wrote:
> Tim Williams wrote:
> > On 28/09/2007, Robin Becker <[EMAIL PROTECTED]> wrote:
> >> Is there a way to use smtplib to get recipient validation. I can use 
> >> smtplib
> >> quite happily to send emails using the locahost's sendmail, but sendmail 
> >> is just
> >>  fire and forget, so some bad addresses eg [EMAIL PROTECTED] don't cause 
> >> any
> >> error in the sending application. I know some smtp setups do enforce 
> >> recipient
> >> validation, but it doesn't seem terribly easy to do this with sendmail. I
> >> wondered if there were some way to do this in python?
> >
> > There is no way of  validating *every* email address you send to using
> > SMTP alone.   Some servers accept every address and bounce later - as
> > you have found out. So for the purpose of the SMTP client, or relaying
> > server,  the address is valid at sending time to those servers.
> >
> > Checking DNS for MX records is a possibility for removing some bad
> > addresses, but it's not fool proof as the RFCs don't require MX
> > records to exist for a domain to be able to receive email.  If no MX
> > records are present, one (and only one!) IP address returned from the
> > domain's A record(s) should be tried.
> >
> > HTH :)
> Thanks, it's at least ammunition for me to say it cannot easily be done. I 
> found
> this milter
>
> http://www.jmaimon.com/sendmail/callahead-milter/
>
> but I think this will cause every send to be checked which is probably not 
> what
> we need.


Hmm,  call-ahead functions just initiate the first part of the SMTP
dialogue - to the RCPT TO,   unless you cache the results so that the
call-ahead only checks each address once a day or so there is no
benefit.  Without caching it will just slow down sending process as
you will get 1.5 SMTP conversations per outgoing message instead of
just 1.However,  they still won't catch invalid email addresses
when the server accepts all addresses* and bounces later.

* all addresses = all addresses on domains local to that server.

I have written functions like this in the past for outbound/inbound
(recipient/sender) address checking,  using combinations of SMTP
dialogue, DNS and port checking, bounce-collection, SPF and other
techniques over the years.   There is no guaranteed way of checking
that all email addresses in your list are either VALID or INVALID.
Valid email addresses can get refused/bounce for a variety of reasons,
and invalid addresses sometimes get accepted/don't bounce at all.

You should work on either a best-effort basis,  running some checks
but accepting that its not foolproof  -OR- use no checks at all
knowing that most invalid email addresses will be handled correctly by
the SMTP processes

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: recipient validation with smtplib

[Tim Williams]

On 28/09/2007, Robin Becker <[EMAIL PROTECTED]> wrote:
> Is there a way to use smtplib to get recipient validation. I can use smtplib
> quite happily to send emails using the locahost's sendmail, but sendmail is 
> just
>  fire and forget, so some bad addresses eg [EMAIL PROTECTED] don't cause any
> error in the sending application. I know some smtp setups do enforce recipient
> validation, but it doesn't seem terribly easy to do this with sendmail. I
> wondered if there were some way to do this in python?

There is no way of  validating *every* email address you send to using
SMTP alone.   Some servers accept every address and bounce later - as
you have found out. So for the purpose of the SMTP client, or relaying
server,  the address is valid at sending time to those servers.

Checking DNS for MX records is a possibility for removing some bad
addresses, but it's not fool proof as the RFCs don't require MX
records to exist for a domain to be able to receive email.  If no MX
records are present, one (and only one!) IP address returned from the
domain's A record(s) should be tried.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: I could use some help making this Python code run faster using only Python code.

[Tim Williams]

On 21/09/2007, Tim Williams <[EMAIL PROTECTED]> wrote:
> On 20/09/2007, Python Maniac <[EMAIL PROTECTED]> wrote:
> > I am new to Python however I would like some feedback from those who
> > know more about Python than I do at this time.
> >
> > def scrambleLine(line):
> >s = ''
> >for c in line:
> >s += chr(ord(c) | 0x80)
> >return s
> >
> > def descrambleLine(line):
> >s = ''
> >for c in line:
> >s += chr(ord(c) & 0x7f)
> >return ''.join( [chr(ord(c) & 0x7f) for c in line] )
> >
> > def scrambleFile(fname,action=1):
> >if (path.exists(fname)):
> >try:
> >f = open(fname, "r")
> >toks = fname.split('.')
> >while (len(toks) > 2):
> >toks.pop()
> >fname = '.'.join(toks)
> >if (action == 1):
> >_fname = fname + '.scrambled'
> >elif (action == 0):
> >_fname = fname + '.descrambled'
> >if (path.exists(_fname)):
> >os.remove(_fname)
> >ff = open(_fname, "w+")
> >if (action == 1):
> >for l in f:
> >ff.write(scrambleLine(l))
> >elif (action == 0):
> >for l in f:
> >ff.write(descrambleLine(l))
> >except Exception, details:
> >print 'ERROR :: (%s)' % details
> >finally:
> >f.close()
> >ff.close()
> >else:
> >print 'WARNING :: Missing file "%s" - cannot continue.' % fname
> >
> > --
>
>
> def scrambleLine(line):
>   return ''.join( [chr(ord(c) | 0x80) for c in line] )
>
> def descrambleLine(line):
>return ''.join( [chr(ord(c) & 0x7f) for c in line] )
>
> def scrambleFile(fname,action=1):
>   try:
>   f = open(fname, "r")
>   fname = '.'.join(fname.split('.')[:2])
>   if action:
>   _fname = fname + '.scrambled'
>   else:
>   _fname = fname + '.descrambled'
>   ff = open(_fname, "w")
>   if action:
>   ff.write('\r\n.join([scrambleLine(l) for l in f ]))
>   else :
>   ff.write('\r\n.join([descrambleLine(l) for l in f ]))
>   f.close()
>   ff.close()
>   except Exception, details:
>   print 'ERROR :: (%s)' % details
>
> HTH :)
>

or maybe even this:

Apologies for the self-reply, its late here !
(a couple of typos fixed too! )

def scrambleFile(fname,action=1):
  try:
  f = open(fname, "r")
  fname = '.'.join(fname.split('.')[:2])
  if action:
  ff = open(fname + '.scrambled', "w")
  ff.write('\r\n'.join([scrambleLine(l) for l in f ]))
  else :
  ff = open(fname + '.descrambled', "w")
  ff.write('\r\n'.join([descrambleLine(l) for l in f ]))
  f.close()
  ff.close()

  except Exception, details:
  print 'ERROR :: (%s)' % details

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: I could use some help making this Python code run faster using only Python code.

[Tim Williams]

On 20/09/2007, Python Maniac <[EMAIL PROTECTED]> wrote:
> I am new to Python however I would like some feedback from those who
> know more about Python than I do at this time.
>
> def scrambleLine(line):
>s = ''
>for c in line:
>s += chr(ord(c) | 0x80)
>return s
>
> def descrambleLine(line):
>s = ''
>for c in line:
>s += chr(ord(c) & 0x7f)
>return ''.join( [chr(ord(c) & 0x7f) for c in line] )
>
> def scrambleFile(fname,action=1):
>if (path.exists(fname)):
>try:
>f = open(fname, "r")
>toks = fname.split('.')
>while (len(toks) > 2):
>toks.pop()
>fname = '.'.join(toks)
>if (action == 1):
>_fname = fname + '.scrambled'
>elif (action == 0):
>_fname = fname + '.descrambled'
>if (path.exists(_fname)):
>os.remove(_fname)
>ff = open(_fname, "w+")
>if (action == 1):
>for l in f:
>ff.write(scrambleLine(l))
>elif (action == 0):
>for l in f:
>ff.write(descrambleLine(l))
>except Exception, details:
>print 'ERROR :: (%s)' % details
>finally:
>f.close()
>ff.close()
>else:
>print 'WARNING :: Missing file "%s" - cannot continue.' % fname
>
> --


def scrambleLine(line):
   return ''.join( [chr(ord(c) | 0x80) for c in line] )

def descrambleLine(line):
return ''.join( [chr(ord(c) & 0x7f) for c in line] )

def scrambleFile(fname,action=1):
   try:
   f = open(fname, "r")
   fname = '.'.join(fname.split('.')[:2])
   if action:
   _fname = fname + '.scrambled'
   else:
   _fname = fname + '.descrambled'
   ff = open(_fname, "w")
   if action:
   ff.write('\r\n.join([scrambleLine(l) for l in f ]))
   else :
   ff.write('\r\n.join([descrambleLine(l) for l in f ]))
   f.close()
   ff.close()
   except Exception, details:
   print 'ERROR :: (%s)' % details

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: trim start and trailing space chars from string

[Tim Williams]

On 15/09/2007, Konstantinos Pachopoulos <[EMAIL PROTECTED]> wrote:
> Hi,
> is there something corresponding to the java String.trim() method, ie
> trim start and trailing space/tab chars from string?
> say convert " asdf   "  to "asdf"?

>>> ' asdf '.strip()
'asdf'
>>> ' asdf '.rstrip()
' asdf'
>>> ' asdf '.lstrip()
'asdf '
>>>
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: smtp debugging methods

[Tim Williams]

On 14/09/2007, Sean Nakasone <[EMAIL PROTECTED]> wrote:
> I'm having trouble with sending smtp mail.  It's hanging after the
> smtplib.SMTP() line. It doesn't works from home but not from work.  What's
> the best way to debug this?
>
> # Here's my script
> import smtplib
> msg = "Subject: Hello\n\nThis is the\nbody of the message."
> server = smtplib.SMTP("smtp.gmail.com",465)
>   # "Connection refused" normally means there is no server listening for
>   # connections on the specified IP/port-combination.
>   # use netstat -an to view connections.
> server.set_debuglevel(1)
> server.ehlo()
> server.starttls()
> server.ehlo()
> # !!! set the password
> server.login("myuser", "mypass")
> server.sendmail("...
>
> # Here's the error
> >>> server = smtplib.SMTP("smtp.gmail.com",465)
> Traceback (most recent call last):
>   File "", line 1, in ?
>   File "/usr/lib/python2.4/smtplib.py", line 241, in __init__
> (code, msg) = self.connect(host, port)
>   File "/usr/lib/python2.4/smtplib.py", line 304, in connect
> (code, msg) = self.getreply()
>   File "/usr/lib/python2.4/smtplib.py", line 345, in getreply
> line = self.file.readline()
>   File "/usr/lib/python2.4/socket.py", line 340, in readline
> data = self._sock.recv(self._rbufsize)
> socket.error: (113, 'Software caused connection abort')

There is no SMTP service on port 465 , its some other "service" or the
smtp server is in trouble,   try it with port 587 instead.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: extract text from log file using re

[Tim Williams]

On 13/09/2007, Fabian Braennstroem <[EMAIL PROTECTED]> wrote:
> me again... I should describe it better:
> the result should be an array with just:
>
> 498 1.0086e-03 2.4608e-04 9.8589e-05 1.4908e-04 8.3956e-04
> 3.8560e-03 4.8384e-02 11:40:01  499
> 499 1.0086e-03 2.4608e-04 9.8589e-05 1.4908e-04  8.3956e-04
> 3.8560e-03 4.8384e-02 11:40:01  499
> 500 1.0049e-03 2.4630e-04 9.8395e-05 1.4865e-04 8.3913e-04
> 3.8545e-03 1.3315e-01 11:14:10  500
> 501 1.0086e-03 2.4608e-04 9.8589e-05 1.4908e-04 8.3956e-04
> 3.8560e-03 4.8384e-02 11:40:01  499
>
> as field values.
>
> Fabian Braennstroem schrieb am 09/13/2007 09:09 PM:
> > Hi,
> >
> > I would like to delete a region on a log file which has this
> > kind of structure:
> >
> >
> > #--flutest
> >498 1.0086e-03 2.4608e-04 9.8589e-05 1.4908e-04
> > 8.3956e-04 3.8560e-03 4.8384e-02 11:40:01  499
> >499 1.0086e-03 2.4608e-04 9.8589e-05 1.4908e-04
> > 8.3956e-04 3.8560e-03 4.8384e-02 11:40:01  499
> > reversed flow in 1 faces on pressure-outlet 35.
> >
> > Writing
> > "/home/gcae504/SCR1/Solververgleich/Klimakruemmer_AK/CAD/Daimler/fluent-0500.cas"...
> >  5429199 mixed cells, zone 29, binary.
> > 11187656 mixed interior faces, zone 30, binary.
> >20004 triangular wall faces, zone 31, binary.
> > 1104 mixed velocity-inlet faces, zone 32, binary.
> >   133638 triangular wall faces, zone 33, binary.
> >14529 triangular wall faces, zone 34, binary.
> > 1350 mixed pressure-outlet faces, zone 35, binary.
> >11714 mixed wall faces, zone 36, binary.
> >  1232141 nodes, binary.
> >  1232141 node flags, binary.
> > Done.
> >
> >
> > Writing
> > "/home/gcae504/SCR1/Solververgleich/Klimakruemmer_AK/CAD/Daimler/fluent-0500.dat"...
> > Done.
> >
> >500 1.0049e-03 2.4630e-04 9.8395e-05 1.4865e-04
> > 8.3913e-04 3.8545e-03 1.3315e-01 11:14:10  500
> >
> >  reversed flow in 2 faces on pressure-outlet 35.
> >501 1.0086e-03 2.4608e-04 9.8589e-05 1.4908e-04
> > 8.3956e-04 3.8560e-03 4.8384e-02 11:40:01  499
> >
> > #--
> >
> > I have a small script, which removes lines starting with
> > '(re)versed', '(i)teration' and '(t)urbulent'  and put the
> > rest into an array:
> >
> > # -- plot residuals 
> >   import re
> > filename="flutest"
> > reversed_flow=re.compile('^\ re')
> > turbulent_viscosity_ratio=re.compile('^\ tu')
> > iteration=re.compile('^\ \ i')
> >
> > begin_of_res=re.compile('>\ \ \ i')
> > end_of_res=re.compile('^\ ad')
> >
> > begin_of_writing=re.compile('^\Writing')
> > end_of_writing=re.compile('^\Done')
> >
> > end_number=0
> > begin_number=0
> >
> >
> > n = 0
> > for line in open(filename).readlines():
> > n = n + 1
> > if begin_of_res.match(line):
> > begin_number=n+1
> > print "Line Number (begin): " + str(n)
> >
> > if end_of_res.match(line):
> > end_number=n
> > print "Line Number (end): " + str(n)
> >
> > if begin_of_writing.match(line):
> > begin_w=n+1
> > print "BeginWriting: " + str(n)
> > print "HALLO"
> >
> > if end_of_writing.match(line):
> > end_w=n+1
> > print "EndWriting: " +str(n)
> >
> > if n > end_number:
> > end_number=n
> > print "Line Number (end): " + str(end_number)
> >
> >
> >
> >
> >
> > n = 0
> > array = []
> > array_dummy = []
> > array_mapped = []
> >
> > mapped = []
> > mappe = []
> >
> > n = 0
> > for line in open(filename).readlines():
> > n = n + 1
> > if (begin_number <= n) and (end_number > n):
> > #if (begin_w <= n) and (end_w > n):
> > if not reversed_flow.match(line) and not
> > iteration.match(line) and not
> > turbulent_viscosity_ratio.match(line):
> > m=(line.strip().split())
> > print m
> > if len(m) > 0:
> > #print len(m)
> > laenge_liste=len(m)
> > #print len(m)
> > mappe.append(m)
> >
> >
> > #--end plot
> > residuals-
> >
> > This works fine ; except for the region with the writing
> > information:
> >
> > #-writing information
> > -
> > Writing "/home/fb/fluent-0500.cas"...
> >  5429199 mixed cells, zone 29, binary.
> > 11187656 mixed interior faces, zone 30, binary.
> >20004 triangular wall faces, zone 31, binary.
> > 1104 mixed velocity-inlet faces, zone 32, binary.
> >   133638 triangular wall faces, zone 33, binary.
> >14529 triangular wall faces, zone 34, binary.
> > 1350 mixed pressure-outlet faces, zone 35, binary.
> >11714 mixed wall faces, zone 36, binary.
> >  1232141 nodes, binary.
> >  1232141 node flags, binary.
> > Done.
> > # ---end writing information ---
> >
> > Does anyone know, how I can this 'writing' stuff 

Re: why should I learn python

[Tim Williams]

On 07/09/07, Tom Brown <[EMAIL PROTECTED]> wrote:
> On Thursday 06 September 2007 16:01, windandwaves wrote:
> > Hmmm, thank you all for your replies.  I will do some research on the
> > net (i did some already, but because I am really not much of a
> > programmer, it is often too detailed for me).  I have limited time,
> > but it does sound like something to learn, just for fun and for
> > practical use.  How would you use it in a web development
> > environment?  I mean, in real practical terms.  Could it assist with
> > php? Is it easy to write GUI programs in Python?
>
> Checkout http://www.djangoproject.com/ or http://turbogears.org/ for web
> development. Checkout http://www.riverbankcomputing.co.uk/pyqt/index.php for
> writing GUI programs. There are other options for GUI apps. That is the one I
> use all the time.

Also, check out Karrigell ( www.karrigell.com) .  It will show you
just how easy & fast Python can be for web development.  It has its
own web server, or it can sit behind Apache etc.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: startswith( prefix[, start[, end]]) Query

[Tim Williams]

On 06/09/07, Bruno Desthuilliers
<[EMAIL PROTECTED]> wrote:
>
> You may want to try with a regexp, but I'm not sure it's worth it (hint:
> the timeit module is great for quick small benchmarks).
>
> Else, you could as well write your own testing function:
>
> def str_starts_with(astring, *prefixes):
>   startswith = astring.startswith
>   for prefix in prefixes:
> if startswith(prefix):
>   return true
>   return false
>
> for line in f:
>   if str_starts_with(line, 'abc, 'de', 'xxx'):
> # CODE HERE
>

Isn't slicing still faster than startswith?As you mention timeit,
then you should probably add slicing to the pot too :)

if astring[:len(prefix)] == prefix:
 do_stuff()

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Image.open( "C:\test.jpg") is this wrong ?

[Tim Williams]

On 27/08/07, Simon Brunning <[EMAIL PROTECTED]> wrote:
> On 8/27/07, Carnell, James E <[EMAIL PROTECTED]> wrote:
>
> > Image.open("C:\test.jpg")
>
> Try:
>
> Image.open(r"C:\test.jpg")
>
> See http://docs.python.org/ref/strings.html

r"C:\test.jpg"

also

"C:\\test.jpg"  or  'C:/test.jpg'
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Using Regular Expresions to change .htm to .php in files

[Tim Williams]

On 24/08/07, J. Cliff Dyer <[EMAIL PROTECTED]> wrote:
> Tim Williams wrote:
> > On 23/08/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> >
> >> Hi,
> >>
> >> I have a bunch of files that have changed from standard htm files to
> >> php files but all the links inside the site are now broken because
> >> they point to the .htm files while they are now .php files.
> >>
> >> Does anyone have an idea about how to do a simple script that changes
> >> each .htm in a given file to a .php
> >>
> >> Thanks a lot in advance
> >>
> >>
> >
> > Something like:
> >
> > Infile = open(f_name,'r+')
> > Data =  Infile.read()
> > InFile.write(Data.replace('.htm','.php'))
> > Infile.close()
> >
> > :)
> >
> Yeah, but you'd better make darn sure that *all* links point to .htm
> files (including external links), because you could very easily end up
> pointing to http://some.othersite.com/index.phpl
>
> And that's just no good.
>
>


-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Using Regular Expresions to change .htm to .php in files

[Tim Williams]

On 23/08/07, Tim Williams <[EMAIL PROTECTED]> wrote:
> On 23/08/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > I have a bunch of files that have changed from standard htm files to
> > php files but all the links inside the site are now broken because
> > they point to the .htm files while they are now .php files.
> >
> > Does anyone have an idea about how to do a simple script that changes
> > each .htm in a given file to a .php
> >
> > Thanks a lot in advance
> >
>
> Something like:
>
> Infile = open(f_name,'r+')
> Data =  Infile.read()
> InFile.write(Data.replace('.htm','.php'))
> Infile.close()
>

Actually,  scrub that, its been a long day!You either need a
Infile.seek(0)  in the above before the write() , or you can do.

Data = open(f_name).read()
outfile = open(f_name,'w')
outfile.write(Data.replace('.htm','.php'))
outfile.close()
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Using Regular Expresions to change .htm to .php in files

[Tim Williams]

On 23/08/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I have a bunch of files that have changed from standard htm files to
> php files but all the links inside the site are now broken because
> they point to the .htm files while they are now .php files.
>
> Does anyone have an idea about how to do a simple script that changes
> each .htm in a given file to a .php
>
> Thanks a lot in advance
>

Something like:

Infile = open(f_name,'r+')
Data =  Infile.read()
InFile.write(Data.replace('.htm','.php'))
Infile.close()

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading a line in file

[Tim Williams]

On 20/08/07, Brian McCann <[EMAIL PROTECTED]> wrote:
>
> Shawn, Tim ,Jay
>
> many thanks,
>
> It looks like there are many ways this problem can be approached
>
> either by using  regex or a tokens
>
> Tim I'm not familiar with your solution, but will learn about that method
> also

Hi Brian,

> buildNum =  open('input.txt').read().split('build.number=')[1].split()[0]

Try this on its own:

print open('input.txt').read().split('build.number=')

See what is at the very beginning of the 2nd list item :)

My example just splits the whole file at "build.number=", so you know
the data you require is at the beginning of the 2nd list item returned
from the slice [ie: a_list[1].  You also know that data is followed by
a newline, so it will be the first item in the returned list [ie:
b_list[0] when you split a_list[1].

No need to iterate each line individually looking for a match and then
process the matching line to get at the data.  You can just go
straight to the data you require.

If your requirement is for multiple items from a single file then
another method would be required.

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading a line in file

[Tim Williams]

On 20/08/07, Shawn Milochik <[EMAIL PROTECTED]> wrote:
> Hopefully this will help (using your input file)
>
> #!/usr/bin/env python
> import re
> buildinfo = "input.txt"
> input = open(buildinfo, 'r')
>
> regex = re.compile(r"^\s*build.number=(\d+)\s*$")
>
> for line in input:
>if re.search(regex, line):
>print line
>buildNum = re.sub(r"^\s*build.number=(\d+)\s*$", "\\1", line)
>print line
>print buildNum
> --

If I misunderstood the original post and the build number is all that
is required from the file, then:

buildNum =  open('input.txt').read().split('build.number=')[1].split()[0]

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading a line in file

[Tim Williams]

On 20/08/07, Brian McCann <[EMAIL PROTECTED]> wrote:
>
>
>
> 
> From: [EMAIL PROTECTED] on behalf of Tim Williams
> Sent: Mon 8/20/2007 2:59 PM
> To: Brian McCann
> Cc: python-list@python.org
> Subject: Re: reading a line in file
>
>
>
>
> On 20/08/07, Brian McCann <[EMAIL PROTECTED]> wrote:
> >
> > Hi,
> >
> > I can read in the whole file build.number which has the following lines
> > how do I just capture the value of build.number and assign it to a
> variable
> > Thanks,
> > Brian
> >
> > contents of file build.number:
> > #Build Number for ANT. Do not edit!
> > #Mon Aug 20 04:04:51 EDT 2007
> > build.number=1
> > buildinfo.py
> > ##
> > #!/usr/bin/python
> > import string
> > import os
> > import sys
> > import time
> > import errno
> > import shutil
> > buildinfo = "build.number"
> > input = open(buildinfo, 'r')
> > for line in input:
> > print line
> > #
> >
> > command line when script is run
> > $ buildinfo.py
> > #Build Number for ANT. Do not edit!
> >
> > #Mon Aug 20 04:04:51 EDT 2007
> > build.number=1
> >
> >
>
> This is preferred nowadays
>
> for line in open(buildinfo):
> print line
>
> Without a sample of the data, no-one can help you further.   If this
> is homework, you should say so, people will give you guidance :)
>



> Hi Tim,
> The sample data is in file build.number
>
> contents of file build.number:
>
>  #Build Number for ANT. Do not edit!
>  #Mon Aug 20 04:04:51 EDT 2007
> build.number=1
>
> Thanks,
> Brian
>
(bottom posting is preferred here :)  )

Brian,  can you expand on this a bit?A single entry doesn't give
much to go on.   20-ish lines would be better.Anyone looking at
this would need to see whether each entry was on its own line, whether
there are duplicates,  whether delimiters are always the same etc.
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: reading a line in file

[Tim Williams]

On 20/08/07, Brian McCann <[EMAIL PROTECTED]> wrote:
>
> Hi,
>
> I can read in the whole file build.number which has the following lines
> how do I just capture the value of build.number and assign it to a variable
> Thanks,
> Brian
>
> contents of file build.number:
> #Build Number for ANT. Do not edit!
> #Mon Aug 20 04:04:51 EDT 2007
> build.number=1
> buildinfo.py
> ##
> #!/usr/bin/python
> import string
> import os
> import sys
> import time
> import errno
> import shutil
> buildinfo = "build.number"
> input = open(buildinfo, 'r')
> for line in input:
> print line
> #
>
> command line when script is run
> $ buildinfo.py
> #Build Number for ANT. Do not edit!
>
> #Mon Aug 20 04:04:51 EDT 2007
> build.number=1
>
>

This is preferred nowadays

for line in open(buildinfo):
print line

Without a sample of the data, no-one can help you further.   If this
is homework, you should say so, people will give you guidance :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: clarification

[Tim Williams]

On 17/08/07, Beema shafreen <[EMAIL PROTECTED]> wrote:
> hi everybody,
> i have a file with data separated by tab
> mydata:
> fhl1fkh2
> dfp1chk1
> mal3alp14
> mal3moe1
> mal3spi1
> mal3bub1
> mal3bub3
> mal3mph1
> mal3mad3
> hob1nak1
> hob1wsp1
> hob1rad3
> cdr2cdc13
> cdr2cdc2
> shows these two are separated by tab represented as columns
> i have to check the common data between these two coloumn1 an coloumn2
> my code:
> data = []
> data1 = []
> result = []
> fh = open('sheet1','r')
> for line in fh.readlines():
> splitted = line.strip().split('\t')
> data.append(splitted[0])
> data1.append(splitted[1])
> for k in data:
> if k in data1:
> result.append(k)
> print result
> fh.close()
>
> can you tell me problem with my script and what should is do for this

For a start, you are iterating k in data  *everytime* you iterate a
line in fh  which will give you a speed issue and give you duplicates
in the result.  The following is probably what you intended to do

> for line in fh.readlines():
> do stuff
> for k in data:
> do stuff

.split()  splits by spaces, newlines AND tabs so you just need

> splitted = line.split()

eg

>>> ln = 'fhl1\tfkh2\r\n'
>>> ln.split()
['fhl1', 'fkh2']

I think I would have done something like this (not tested)

Input = open('sheet1').read().split()
data = set(Input[::2])
data1 = set (Input[1::2])
result = data.intersection(data1)

or even this (if you don't need data and data1 later in the code)

Input = open('sheet1').read().split()
result = set(Input[::2]).intersection(set (Input[1::2]))


HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Problems with headers in email.message

[Tim Williams]

On 04/08/07, Slippy <[EMAIL PROTECTED]> wrote:
> Hi, python newbie, struggling to learn here. I'm trying to write a
> simple program which posts messages to my google group (via email).
> I'm using smtplib, email and email.message to build and send a
> message, but all the header attributes are appearing in the message
> body, so my messages are arriving with loads of junk in the body, no
> subject line and only the skinniest of headers. I know I'm doing
> something wrong, but I don't know what...
>
> Here's a simplification of what I'm doingessentially, I've taken
> from what I've learned at
> http://codeidol.com/python/python3/Client-Side-Scripting/pymail-A-Console-Based-Email-Client/
>
> -Snip Here-Snip Here-Snip
> Here-
> import smtplib, email
> from email.message import Message
> m = Message( )
> m['From'] = 'Slippy <[EMAIL PROTECTED]>'
> m['To'] = '[EMAIL PROTECTED]'
> m['Subject'] = 'A Test Message'
> m.set_payload('This is a test email. Please ignore')
> s = smtplib.SMTP('smtp.myemail.com')
> failed =
> s.sendmail('[EMAIL PROTECTED]','[EMAIL PROTECTED]',str(m))
> if failed:
>  print 'Message sending failed.'
> else:
>  print 'Message sent.'
> print 'Bye.'
> -Snip Here-Snip Here-Snip
> Here-
>
> Now, I get all the right responses, and the message sends ok. I go and
> check my inbox, and the message is there, but the From, To and Subject
> lines I created (as well as a preceding blank line and a "From nobody"
> line) are in the message body, followed by the body text.
>
> How do I assign values to the header?
>
> I'd appreciate any help anyone can give me with this.

Your script (as posted) works fine for me.

  I did need to change one import line to:  from email.Message import
Message (note the capitalization), but that was all - originally it
stopped the script dead, so it wasn't the cause of your problem.


-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: beginner in python

[Tim Williams]

On 02/08/07, Beema shafreen <[EMAIL PROTECTED]> wrote:
> Hi everybody ,
>   I am a beginner in python,
>  I have to fetch the redundant entries from a file,
>
> code:
>
> import re
> L = []
> fh = open('ARCHITECTURE_MAIN.txt',
> 'r')
> for line in fh.readlines():
> data =line.strip()
> #   splitted = data.split('#')
> L.append(data)
> fh.close()
>
>
>
> M=L
> for x in L:
> x = x.split('#')
> for y in M:
> y = y.split('#')
> x_data = x[0],x[1],x[2],x[3]
> #print x_data
> y_data = y[0],y[1],y[2],y[3]
> #print y_dat
> if x_data[0] == y_data[0]:
>   print x_data
>
>
> i get the result as a tupule,
> the text file which has datas separated by hash
> entry#isoform#start#stop#  i have to check upto this
>
> 00250_1#ARCH_104#61#89#Literature#9224948#00250
> 00250_1#ARCH_104#97#126#Literature#9224948#00250
> 00250_1#ARCH_104#139#186#Literature#9224948#00250
> 00251_1#ARCH_463#7#59#SMART##00251
> 00251_1#ARCH_463#91#121#SMART##00251
> 00251_1#ARCH_463#251#414#SMART##00251
> 00251_1#ARCH_463#540#624#SMART##00251
> 00252_1#ARCH_474#1#21#Literature#8136357#00252
> 00252_1#ARCH_393#481#501#Literature#8136357#00252
> 00252_1#ARCH_463#523#553#SMART##00252
> 00253_1#ARCH_82#37#362#SMART##00253
> 00253_1#ARCH_54#365#522#SMART##00253
> 00253_1#ARCH_104#589#617#SMART##00253
> 00253_1#ARCH_104#619#647#SMART##00253
> 00253_1#ARCH_104#684#712#SMART##00253
> 00254_1#ARCH_82#27#352#SMART##00254
> 00254_1#ARCH_54#355#510#SMART##00254
> 00254_1#ARCH_104#576#604#SMART##00254
> 00254_1#ARCH_104#606#634#SMART##00254
> 00254_1#ARCH_104#671#699#SMART##00254
> 00255_1#ARCH_82#56#425#SMART##00255
> 00255_1#ARCH_54#428#582#SMART##00255
> 00255_1#ARCH_104#696#724#SMART##00255
>
>
>
>
> can you suggest me ,what are the improvement i have to make in the above
> code
> regards
> shafreen

Shafreen,   your code snippet (as you posted it) prints any lines that
end with an entry code equal the entry code on the last line of the
file, with these lines split at #.

The whole thing (as you posted it) could probably be written something
like this:

===
# not tested or optimised

fh = open('ARCHITECTURE_MAIN.txt').read().splitlines()
last_code = fh[-1].split('#')[0]
for line in fh:
if out_line.startswith(last_code):
print out_line.split('#')
# it will always print at least the last line of the file
===

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: From D

[Tim Williams]

On 26/07/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:

>> The str.split method has no bearing on this discussion,

> It most certainly does. To make '123 456' into an integer,
> you split it and then join it.
> >>> z = '123 456'
> >>> y = z.split()
> >>> x = ''.join(y)
> >>> w = int(x)
> >>> w
> 123456

but it doesn't if you use replace !!   

>>> z = '123 456'
>>> int( z.replace( ' ' ,'' ) )
> 123456


> Propose:
> 123 456 789 => 123456789
> 123.456 789 => 123.456789

+1 for me too

-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Gmail Error using smtplib

[Tim Williams]

On 20/07/07, DJ Fadereu <[EMAIL PROTECTED]> wrote:
> Hello, can anyone help me with this? What am I doing wrong here?
>
> (I've changed private info to /xx)
>  I'm getting an authentication error while using a standard script
> Gmail:
> --SCRIPT-
> import smtplib
> from email.MIMEText import MIMEText
>
> msg = MIMEText('Hello, this is fadereu...')
> >From = '[EMAIL PROTECTED]'
>
> msg['Subject'] = 'Hello'
> msg ['From'] = '[EMAIL PROTECTED]'
> msg['To'] = '[EMAIL PROTECTED]'
>
> s = smtplib.SMTP('alt1.gmail-smtp-in.l.google.com')
> s.set_debuglevel(1)
> s.login('[EMAIL PROTECTED]','x')
> s.sendmail(msg['From'], msg['To'], msg.as_string())
> s.close()
> ERROR--
> Traceback (most recent call last):
>  File "C:\Documents and Settings\Acer User\Desktop\Code\S60 scripts
> \Fadereu's Codez\gmail.py", line 13, in 
>s.login('[EMAIL PROTECTED]','x'')
>  File "C:\Python25\lib\smtplib.py", line 554, in login
>raise SMTPException("SMTP AUTH extension not supported by
> server.")
> SMTPException: SMTP AUTH extension not supported by server.
>

The error fairly self-explanitory :)

>>SMTPException: SMTP AUTH extension not supported by server.

In fact, you are trying to send outbound email through an inbound
email server.  You need to use GMAIL's outbound server.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Copy List

[Tim Williams]

On 18/07/07, Robert Rawlins - Think Blue
<[EMAIL PROTECTED]> wrote:

>
> What's the best way to create a copy of a list? I've seen several method and
> I'm not sure what to use. This will be in a class and one method creates a
> list which I then want to move to the self scope, like so:
>

listB = listA[:]

hth :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: avoid script running twice

[Tim Williams]

On 18/06/07, Nick Craig-Wood <[EMAIL PROTECTED]> wrote:
> Tim Williams <[EMAIL PROTECTED]> wrote:
> >  You can also do this by holding a file open in write mode until the
> >  script has finished.
> >
> >try:
> > open('lock.txt','w')
> > my_script()
> >   except:
> >#print script is already running
>
> That only works under windows
>
>  >>> f=open('lock.txt','w')
>  >>> g=open('lock.txt','w')
>  >>> f.write('hi')
>  >>> g.write('ho')
>  >>> f.close()
>  >>> g.close()
>  >>> open('lock.txt').read()
>  'ho'
>  >>>
>
> The best cross platform way to create a lock is creating a directory.
> It is atomic on both windows and linux anyway.
>
>  try:
>os.mkdir("lock")
>  except OSError:
>print "locked!"
>  else:
>try:
>  do_stuff()
>finally:
>  os.rmdir("lock")
>
> (untested)
>

Being a windows-only person, I didn't know that :)

Actually I think I did,  this thread has happened before - a few months ago :)

I would be worried with the directory-exists option for the same
reason I don't use the file-exists method currently.  It is possible
for the directory to exist when the script isn't running, thus
preventing the script from running again until someone notices.

On Windows the open-a-file-for-writing method works well, but as *nix
doesn't work the same way then maybe the socket solution is the best
cross-platform option.  The socket can't exist when the script isn't
running, and if you try and create a duplicate socket you catch the
exception and exit.

IMHO of course.

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: avoid script running twice

[Tim Williams]

On 18/06/07, Robin Becker <[EMAIL PROTECTED]> wrote:
> Wildemar Wildenburger wrote:
> > Robin Becker wrote:
> .
> >
> > Well I can think of a dumb way: create a temporary file during the
> > transaction and have your script check for that before running its main
> > body.
> >
> >
> > I think thats the most hassle free way of doing it.
> > /W
> I looked at the temporary files idea, but I'm not certain about the exact
> details. Normally your create a file and then remove it whilst keeping the 
> file
> handle; that allows your program to write to it whilst guaranteeing that it 
> will
> vanish when you die, but this has to be a named file so that the second 
> instance
> can check for it.


Doesn't that prevent it from being already removed? My unix
> experience is long, but fairly primitive.


You don't need to remove the file, write anything to it,  or check for
prior existance :)

If one process has the file open for writing, no other process can
open it for writing at the same time - and this is what you are
checking for!   The exception that the second concurrent open/write
attempt raises tells you that another instance of the script is
running.

This has the added advantage that should something go wrong, such as
an abnormal termination or reboot,  the open/write disappears and the
next time the script runs everything is back to normal.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: avoid script running twice

[Tim Williams]

On 18/06/07, Wildemar Wildenburger <[EMAIL PROTECTED]> wrote:
> Robin Becker wrote:
> > I wish to prevent a python script from running twice; it's an hourly job, 
> > but
> > can take too long.
> >
> > [snip]
> > but it occurs to me that I might be killed with prejudice during the long
> > running work(). Is there a smart way to avoid running simultaneously.
> >
>
> Well I can think of a dumb way: create a temporary file during the
> transaction and have your script check for that before running its main
> body.

>
> I think thats the most hassle free way of doing it.

If the script finishes abnormally, the file will still exist and
future execution of the script will fail.

:)




-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: avoid script running twice

[Tim Williams]

On 18/06/07, Evan Klitzke <[EMAIL PROTECTED]> wrote:
> On 6/18/07, Robin Becker <[EMAIL PROTECTED]> wrote:
> > I wish to prevent a python script from running twice; it's an hourly job, 
> > but
> > can take too long.
> >
> > My simplistic script looks like
> >
> >
> > ...
> > def main():
> >  fn = 'MARKER'
> >  if os.path.isfile(fn):
> >  log('%s: hourly job running already' % formatTime())
> >  else:
> >  f = open(fn,'w')
> >  f.write(str(os.getpid()))
> >  f.close()
> >  try:
> > work()
> >  finally:
> >  os.remove(fn)
> >
> > if __name__=='__main__':
> >  main()
> >
> > but it occurs to me that I might be killed with prejudice during the long
> > running work(). Is there a smart way to avoid running simultaneously.
>
> Another method that you can use is to open up a socket on some
> predetermined port (presumably above 1024), and then have your program
> try to connect to that port and "talk" to the other program to
> determine whether or not to run (or whether to do some of the
> remaining work, etc.).

You don't need to talk to the socket, a second script trying to create
a second socket on the same number will throw an exception and you can
exit the script cleanly without running a second copy.

You can also do this by holding a file open in write mode until the
script has finished.

  try:
   open('lock.txt','w')
   my_script()
 except:
  #print script is already running

If the file is already open the script won't run,   if the script
finshes/crashes or the machine reboots the open file will close.


In both cases if the script finishes normally or crashes, or the
machine is restarted. The lock  (ie socket or open file) is released.

HTH :)






-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: smtp server simulation using Python

[Tim Williams]

On 17/06/07, William Gill <[EMAIL PROTECTED]> wrote:
> I have a (web) development computer w/o an SMTP server and want to test
> form generated e-mail using a dummy SMTP server that delivers the mail
> message to a file, or better yet, to a text editor instead of actually
> sending it.  Is it possible to extend the DebuggingServer class,and
> override the process_message() method to accomplish this?  If so, any
> suggestions are appreciated.
>

Search the list archives for SMTPRIG.py  :)

Tim
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Printing dots in sequence ('...')

[Tim Williams]

On 22 May 2007 01:02:31 -0700, beertje <[EMAIL PROTECTED]> wrote:
> This is a very newbie question for my first post, perhaps
> appropriately.
>
> I want to print '' gradually, as a progress indicator. I have a
> for-loop that every 10 steps executes:
> print '.',
>
> This results in something like 'Loading. . . .', whereas I want
> 'Loading'
>
> A pet peeve, I can't for the life of me figure out how to get this
> desired output. How do I print dots - or anything for that matter - in
> sequence without a space being inserted in between?
>

maybe this:   (on Win32, don't know about *nix)

for x in range(10):
  print '.\b',



-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Automatic login to website (newbie)

[Tim Williams]

On 15 May 2007 06:38:45 -0700, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> I'm trying to use PAMIE to login to a website:
>
> import cPAMIE
>
> # python.org - just a test, works fine
> ie = cPAMIE.PAMIE()
> website = "http://www.python.org";
> ie.navigate(website)
> ie.textBoxSet('q', 'pamie')
> ie.buttonClick('submit')
>
> # expekt.com - this is what I want to do, but it fails
> ie = cPAMIE.PAMIE()
> website = "http://www.expekt.com/eng";
> ie.navigate(website)
> ie.textBoxSet('user', 'MyLogin')
> ie.textBoxSet('pass', 'MyPassword')
> ie.buttonClick('actn')

I don't have PAMIE installed nor have I ever used it,   but the login
area is in a frame and I've had problems with other screen scrapers
and frames.

The frame URL is http://www.expekt.com/contenttop.jsp ,  you could try
navigating directly to the frame to see if it helps

website = "http://www.expekt.com/contenttop.jsp";
ie.navigate(website)
ie.textBoxSet('user', 'MyLogin')
ie.textBoxSet('pass', 'MyPassword')
ie.buttonClick('actn')

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: find out all threads?

[Tim Williams]

On 11/05/07, Sven Rech <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I have a written a C program which makes use of python embedding.
> I want to find out all threads that a loaded module has started.
> But I can't find anything about this in the docs. Is it possible?
>

Without details of your module, its dificult to say,  maybe

t_count = threading.activeCount()
or
t_count = threading.enumerate()

will do what you need
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: How to check if a string is empty in python?

[Tim Williams]

On 4 May 2007 03:02:37 -0700, Jaswant <[EMAIL PROTECTED]> wrote:
> This is  a simple way to do it i think
>
>
> s=hello
>
> >>> if(len(s)==0):
>  print "Empty"
>  else:
>  print s
> 
> hello

Not as simple as   " If not s: "

and nowhere near as simple as  "  print s or 'Empty'  "   :) :)


>>> s = ''
>>> print s or 'Empty'
Empty
>>> s = 'hello'
>>> print s or 'Empty'
hello
>>>
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Can't Get Email Interface Working

[Tim Williams]

On 07/04/07, Eric Price <[EMAIL PROTECTED]> wrote:
> Good grief! And they call a 722-line program "simple"?! LOL!
> I did what I need to do with a __one_line_shell_script__ LOL!
> Naw, if I have to go through all that, I'll skip on python this time around,
> thank you very much!
> Eric

Yup, its not so simple

Your problem is :

 File "/usr/local/lib/python2.4/mimetools.py", line 130, in choose_boundary
   hostid = socket.gethostbyname(socket.gethostname())
socket.gaierror: (8, 'hostname nor servname provided, or not known')

What do you get if you do the following in your interpreter?


>>> import socket
>>> socket.gethostname()
'twilliams'
>>> socket.gethostbyname(socket.gethostname())
'194.129.107.254'
>>>
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: way to extract only the message from pop3

[Tim Williams]

On 06/04/07, Tim Williams <[EMAIL PROTECTED]> wrote:

> Content: ['text/plain', 'text/html', 'message/delivery-status',
> 'text/plain', 'text/plain', 'text/plain', 'unknown', 'message/rfc822',
> 'text/plain', 'text/html']

I should explain that this was the content in a single email

>
> # part.get_content_maintype() requires a further call
> # to get_content_subtype() , so use
> # part.get_content_type() instead.
>
> required = ['text/plain', 'text/tab-separated-values']
> for part in EMAIL_OBJ.walk():
> text_parts = []
> if part.get_content_type() in required:
>  text_parts.append(part)
>
> print ('\r\n' + '='*76 +'\r\n').join(text_parts)
> # print all the text parts seperated by a line of '='
> # end

Content: ['text/plain', 'text/html', 'message/delivery-status',
'text/plain', 'text/plain', 'text/plain', 'unknown', 'message/rfc822',
'text/plain', 'text/html']

Is text/html  a text part or an html part for this exercise ?  :)

You need to walk the parts and use something like

# part.get_content_maintype() requires a further call
# to get_content_subtype() , so use
# part.get_content_type() instead.

required = ['text/plain', 'text/tab-separated-values']
for part in EMAIL_OBJ.walk():
   # text_parts = []   <==  oops, this should be above the for.
   if part.get_content_type() in required:
text_parts.append(part)

   print ('\r\n' + '='*76 +'\r\n').join(text_parts)
   # print all the text parts seperated by a line of '='
# end
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: way to extract only the message from pop3

[Tim Williams]

On 05/04/07, Collin Stocks <[EMAIL PROTECTED]> wrote:

> On 3 Apr 2007 12:36:10 -0700, flit <[EMAIL PROTECTED]> wrote:
> > Hello All,
> >
> > Using poplib in python I can extract only the headers using the .top,
> > there is a way to extract only the message text without the headers?
> >

> so get two strings: only headers, and the whole message.
> find the length of the headers, and chop that off the beginning of the whole
> message:
>
> > message=whole_message[len(headers):None]
>

This way you have to perform 2 downloads,  the headers and the whole
message. Then join them both into strings and subtract one from the
other by slicing or other means.

(other means?   body = whole_message.replace(headers,'' )  or maybe not ! :)  )

The body starts at the first blank line after the Subject: header, in
practice this is the first blank line.   This is a good starting point
for something simple like my earlier suggestion:

   msg = '\r\n'.join( M.retr(i+1)[1] )#  retrieve the email into string
   hdrs,body = msg.split('\r\n\r\n',1)# split it into hdrs & body

If the original poster required the body to be seperated from the
headers (and I received a private reply from the OP to my original
post that suggested it probably was)  then splitting a joined whole
message at the first blank line is sufficient and only requires 1
download without using the email module

If the OP required just the text parts extracted from the message then
it gets a bit trickier, the email module is the way to go but not
quite how a previous poster used it.

Consider an email that routed through my (python) SMTP servers and
filters today,.

Content: ['text/plain', 'text/html', 'message/delivery-status',
'text/plain', 'text/plain', 'text/plain', 'unknown', 'message/rfc822',
'text/plain', 'text/html']

Is text/html  a text part or an html part for this exercise ?  :)

You need to walk the parts and use something like

# part.get_content_maintype() requires a further call
# to get_content_subtype() , so use
# part.get_content_type() instead.

required = ['text/plain', 'text/tab-separated-values']
for part in EMAIL_OBJ.walk():
text_parts = []
if part.get_content_type() in required:
 text_parts.append(part)

print ('\r\n' + '='*76 +'\r\n').join(text_parts)
# print all the text parts seperated by a line of '='
# end

Whether you use the email module or not, you need to join the
retrieved message into a string.  You can use \n   but if you plan to
push the text back out in an email  '\r\n' is required for the SMTP
sending part.  Your client may or may not convert \n to \r\n at
sending time :)

HTH :)

-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: way to extract only the message from pop3

[Tim Williams]

On 3 Apr 2007 12:36:10 -0700, flit <[EMAIL PROTECTED]> wrote:
> Hello All,
>
> Using poplib in python I can extract only the headers using the .top,
> there is a way to extract only the message text without the headers?

for i in range( M.stat()[0] ): # M.stat returns msg-count and mbox size
msg = '\r\n'.join( M.retr(i+1)[1] )#  retrieve the email into string
hdrs,body = msg.split('\r\n\r\n',1)# split it into hdrs & body

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Indentifying the LAST occurrence of an item in a list

[Tim Williams]

On 4 Apr 2007 08:58:49 -0700, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> For any list x, x.index(item) returns the index of the FIRST
> occurrence of the item in x. Is there a simple way to identify the
> LAST occurrence of an item in a list? My solution feels complex -
> reverse the list, look for the first occurence of the item in the
> reversed list, and then subtract its index from the length of the list
> - 1, i.e.
>
> LastOcc = len(x) - 1 - x[::-1].index(item)
>
> Is there a simpler solution?

Simpler ?That's subjective. :)

You definitely need to search/iterate a reversed list, or start from
the far end of a non-reversed list.

For fun only.

>>> t = [0,1,2,3,0]

>>> def place(t,i):
... for x,y in zip(t,range(len(t)))[::-1]:  
... if x == i:
... return y
... 
>>> place(t,3)
3
>>> place(t,0)
4
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Is any way to split zip archive to sections?

[Tim Williams]

On 30/03/07, Durumdara <[EMAIL PROTECTED]> wrote:
> Hi!
>
> I want to create some backup archives with python (I want to write a backup
> application in Python).
> Some package managers (7z, arj, winzip) can create splitted archives (1
> mega, 650, 700 mega, etc).
>
> Because I want to ftp these results to a ftp server, I want to split large
> volumes to 15 mb sections.
>
> Can I do it with any python wrapper automatically (like in Cobian), or I
> need to create the large volume, and next split it with another tool?
>
> Or anybody knows about a command line tool (like 7z, or arj) that can expand
> the splitted archive (and I can add files with them from Python one by one)?
>

If you are iterating through a list of files to be backed up, and
adding them to a ZIP one-by-one then you could use something like this
 which adds each file until the zip is over 15mb - then it closes the
ZIP and creates the next one.

Not tested or optimised :)
---
import zipfile

archive_num = 1
outfile = zipfile.ZipFile('/zips/archive%s.zip' % archive_num, "w")
zsize = 0

for full_name in filelist:
full_name_path = os.path.join(full_name, full_path)

if zsize > 15728640 : # 15mb
outfile.close()
archive_num += 1
outfile = zipfile.ZipFile('/zips/archive%s.zip' % archive_num, "w")
zsize= 0

outfile.write( full_name_path , full_name_path ,
zipfile.ZIP_DEFLATED) # add the file
zsize += outfile.getinfo(full_name_path).compress_size #  get
compressed size of file

outfile.close()
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: File deletion after 72 hours of creation

[Tim Williams]

On 29 Mar 2007 13:40:58 -0700, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
> On Mar 29, 12:02 pm, [EMAIL PROTECTED] wrote:
> > Alex> I'm looking for a simple method to delete a folder after 72
> > Alex> "Business hours" (saturday/sunday doesnt count) since its
> > Alex> creation. Note that This is on a linux system and I realize that
> > Alex> it will be the last modified time. These files wont be modified
> > Alex> since their creation.
> >
> > Alex> Im very confused on how to work with the number easily.
> >
> > Take a look at the dateutil module.  Its relativedelta object has some
> > weekday sense:
> >
> >http://labix.org/python-dateutil
> >
> > Skip
>
> Hey, thanks for the reply, I was able to accomplish it (somewhat ugly)
> using the datetime module alone. Here is my code.
> the part with the timestamp.file is just a plaintext file containg
> "#year#month#day" that is created when my client side program copies
> files into my directory.
>
> Just posting the code so if anyone else is wondering how to do this
> ever maybe they can find some of this useful:
> ---
>
> #!/usr/bin/env python
>
> import datetime
> import os
> today = datetime.date.today().toordinal()
> serverFiles = os.listdir("/home/webserver/")
> theDirList=[]
> for xfile in serverFiles:
> if os.path.isdir("/home/webserver/" + xfile) == True:
> theDirList.append(xfile)
>
>
> for xdir in theDirList:
> foo=open("/home/webserver/"+ xdir + "/timestamp.file",'r')
> parseMe = foo.readlines()
> fileDate=parseMe[0].split("#")
> fileYear = fileDate[1]
> fileMonth = fileDate[2]
> fileDay = fileDate[3]
>
> age_of_file = today -
> datetime.date(int(fileYear),int(fileMonth),int(fileDay)).toordinal()
> true_age = age_of_file
> for i in range(age_of_file):
> d=
> datetime.date(int(fileYear),int(fileMonth),int(fileDay)+i)
> ourDay = d.weekday()
> if ourDay == 5 or ourDay == 6:
> true_age = true_age - 1
>
>  print xdir + " : " + str(true_age) + " days old"
>
> --
> http://mail.python.org/mailman/listinfo/python-list
>

You may have "over thought" the problem :)

(Not tested)
--
import os, time

pth = '/home/webserver/'
a_day = 60*60*24
today = time.asctime().split()[0]
cutOffDate = time.time() - (3 * a_day)
if today in ['Mon','Tue','Wed']:
cutOffDate = cutOffDate - (2 * a_day)

for f in os.listdir( pth ):
fname = os.path.join(pth ,f)
if os.path.isfile( fname ) and os.path.getmtime(fname) < cutOffDate:
print fname # os.remove(fname)

--
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Sending emails to 3 addresses....

[Tim Williams]

On 30/03/07, Tim Williams <[EMAIL PROTECTED]> wrote:

Emile,   (slight change to my original reply)

You are passing the TO addresses as 3 addresses in a single string.

[TO] results in a list containing a single string - not a list
containing 3 individual addresses.

You need to either pass the addresses to the function as a list
containing the 3 addresses as individual strings, and remove the
conversion to a list at sending time.  Or change

[TO]

to

TO.split(',')

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Sending emails to 3 addresses....

[Tim Williams]

On 30/03/07, Boudreau, Emile <[EMAIL PROTECTED]> wrote:
>
> sendMail('this is the subject line', 'the results: 71 fails, 229 pass, 300
> total.', '[EMAIL PROTECTED], [EMAIL PROTECTED], [EMAIL PROTECTED]')
>
> def sendMail(subject, body, TO, FROM="[EMAIL PROTECTED]"):
> print TO
> HOST = "exchange.mycompany.com"
> BODY = string.join((
> "From: %s" % FROM,
> "To: %s" % TO,
> "Subject: %s" % subject,
> "",
> body
> ), "\r\n")
> server = smtplib.SMTP(HOST)
> server.sendmail(FROM, [TO], BODY)
> server.quit()
>

Emile,

You are passing the TO addresses as 3 addresses in a single string.
[TO] results in a list containing a single string - not a list
containing 3 individual addresses.

You need to either pass the addresses to the function as a list
containing the 3 addresses as individual strings,  or change

[TO]

to

TO.split(',')


HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Sorting directory contents

[Tim Williams]

On 20/02/07, Wolfgang Draxinger <[EMAIL PROTECTED]> wrote:
> H folks,
>
> I got, hmm not really a problem, more a question of elegance:
>
> In a current project I have to read in some files in a given
> directory in chronological order, so that I can concatenate the
> contents in those files into a new one (it's XML and I have to
> concatenate some subelements, about 4 levels below the root
> element). It all works, but somehow I got the feeling, that my
> solution is not as elegant as it could be:
>
> src_file_paths = dict()
> for fname in os.listdir(sourcedir):
> fpath = sourcedir+os.sep+fname
> if not match_fname_pattern(fname): continue
> src_file_paths[os.stat(fpath).st_mtime] = fpath
> for ftime in src_file_paths.keys().sort():
> read_and_concatenate(src_file_paths[ftime])
>
> of course listdir and sorting could be done in a separate
> function, but I wonder if there was a more elegant approach.
>
> Wolfgang Draxinger
> --
> E-Mail address works, Jabber: [EMAIL PROTECTED], ICQ: 134682867

Are you running on windows?

>>> i,o,e = os.popen3("dir c:\windows /OD /A-D /B")
>>> [x.strip() for x in o.readlines() if 'a' in x ]

Gives a list of filenames (but not directories) in date order, that
match a pattern ('a' in x)

>>> i,o,e = os.popen3("dir c:\windows /O-D /A-D /B")
>>> [x.strip() for x in o.readlines() if 'a' in x]

Gives the same list but in reverse chronological order.

Something containing an approximation of my poor-writing style below
would do the job.
>>> i,o,e = os.popen3("dir c:\windows /OD /A-D /B")
>>> [os.path.join(a_path, x.strip()) for x in o.readlines() if
match_fname_pattern(x)]
['c:/windows/NeroDigital.ini', 'c:/windows/WindowsUpdate.log',
'c:/windows/setupapi.log', 'c:/windows/wiadebug.log',
'c:/windows/wiaservc.log' 

c:\> Dir /? will give you more help

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: While loop with "or"? Please help!

[Tim Williams]

On 25/01/07, Bruno Desthuilliers <[EMAIL PROTECTED]> wrote:
> Peter Otten a écrit :
> > Bruno Desthuilliers wrote:
> >
> >> and simplified again thanks to Python 'in' operator:
> >> while not usrinp.lower() in "yn":
> >
> > But note that 'in' performs a substring search and therefore "yn" and ""
> > would be accepted as valid answers, too.
>
> Mmm, right. Thanks for the correction.
>
> =>
>    while not usrinp.lower() in ['y', 'n']:

or better still

while usrinp.lower() not in ['y', 'n']:

:):)


-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: smtplib starttls gmail example - comments?

[Tim Williams]

On 24/01/07, BJ Swope <[EMAIL PROTECTED]> wrote:
>
>
>
> On 1/24/07, Tim Williams <[EMAIL PROTECTED]> wrote:
> >
> > On 24/01/07, py <[EMAIL PROTECTED]> wrote:
> > > I would love for anybody to comment on this code with regard to
> redundancy/efficiency/wordiness or whatever else.
> > > for instance, do i understand correctly that i cant have a try: else:
> without an intervening except:?
> > > -dave
> > >
> > > stdout.write("calling smtp server...")
> > > try:
> > > server = SMTP(msgsmtp)
> > > except:
> > > stdout.write("FAIL.")   #using .write to avoid the implied
> \n with print
> > > else:
> > > server.set_debuglevel(msgdebug)
> > > stdout.write("starting tls...")
> > > server.ehlo(msgfrom)
> > > try:server.starttls ()
> > > except: stdout.write("FAIL.")
> > > else:
> > > server.ehlo(msgfrom)   #neessary duplication (?)
> > > stdout.write("logging in...")
> > > try:server.login(msgfrom, msgpass)
> > > except: stdout.write("FAIL.")
> > > else:
> > > stdout.write("sending...")
> > > try:server.sendmail(msgfrom, msgto, msgtxt +
> "\n.\n")
> > > except: stdout.write("FAIL.")
> > > else:
> > > try:
> > > server.quit()
> > > except sslerror:  # a known and largely
> ignored issue with early EOF in ssl protocol
> > > stdout.write("success.")
> > > else:
> > > stdout.write("success.")
> > > --
> >
> >
> > *** Not tested  but should have the same functionality and error
> > handling as your script ***
> >
> > this_host = 'myhostname.mydom1.com'
> > print "calling smtp server...", #  the trailing comma removes '\n'
> > try:
> > server =
> smtplib.SMTP(msgsmtp,local_hostname=this_host)
> > server.set_debuglevel(msgdebug)
> > print "starting tls...",
> > server.starttls()
> > server.ehlo(this_host)  # RFC requirement for 2nd EHLO after
> requesting TLS
> > print "logging in...",
> > server.login(msgfrom, msgpass)
> > print "sending...",
> > failed = server.sendmail(msgfrom, msgto, msgtxt + "\n.\n")
> > try:
> > server.quit()
> > except: pass
> > print "success."
> > except:
> > print "FAIL.",
> >
> > if failed:
> > print "failed:", failed  # some recipients, but not all of them,
> failed
> > --
> > http://mail.python.org/mailman/listinfo/python-list
>
>
> Both examples have included the cardinal sin in smtp...
>
>  They both send the message text followed by new line dot new line.
>
>  The smtp protocol specifically mentions CRLF dot CRLF.   Please please
> please use \r\n.\r\n in your code...
>

Ha, yeah I didn't spot that,  but then I wasn't looking for it either :)

However, Its not an issue with smtplib because its takes these kind of
things into account by:

* modifying line endings that aren't RFC compliant to CRLFs.
* normalising/changing a single leading dot (.) to dot dot (..)
* adding the CRLF dot CRLF to the end of the supplied message text.

So adding adding "\n.\n" to the end of the msg text will just add a
line containing  ".."  to the end of the message text, it won't
terminate the DATA part.

that line should therefore be just

failed = server.sendmail(msgfrom, msgto, msgtxt)

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: smtplib starttls gmail example - comments?

[Tim Williams]

On 24/01/07, py <[EMAIL PROTECTED]> wrote:
> I would love for anybody to comment on this code with regard to 
> redundancy/efficiency/wordiness or whatever else.
> for instance, do i understand correctly that i cant have a try: else: without 
> an intervening except:?
> -dave
>
> stdout.write("calling smtp server...")
> try:
> server = SMTP(msgsmtp)
> except:
> stdout.write("FAIL.")   #using .write to avoid the implied \n 
> with print
> else:
> server.set_debuglevel(msgdebug)
> stdout.write("starting tls...")
> server.ehlo(msgfrom)
> try:server.starttls()
> except: stdout.write("FAIL.")
> else:
> server.ehlo(msgfrom)   #neessary duplication (?)
> stdout.write("logging in...")
> try:server.login(msgfrom, msgpass)
> except: stdout.write("FAIL.")
> else:
> stdout.write("sending...")
> try:server.sendmail(msgfrom, msgto, msgtxt + "\n.\n")
> except: stdout.write("FAIL.")
> else:
> try:
> server.quit()
> except sslerror:  # a known and largely ignored 
> issue with early EOF in ssl protocol
> stdout.write("success.")
> else:
> stdout.write("success.")
> --


*** Not tested  but should have the same functionality and error
handling as your script ***

this_host = 'myhostname.mydom1.com'
print "calling smtp server...", #  the trailing comma removes '\n'
try:
server = smtplib.SMTP(msgsmtp,local_hostname=this_host)
server.set_debuglevel(msgdebug)
print "starting tls...",
server.starttls()
server.ehlo(this_host)  # RFC requirement for 2nd EHLO after requesting TLS
print "logging in...",
server.login(msgfrom, msgpass)
print "sending...",
failed = server.sendmail(msgfrom, msgto, msgtxt + "\n.\n")
try:
server.quit()
except: pass
print "success."
except:
print "FAIL.",

if failed:
print "failed:", failed  # some recipients, but not all of them, failed
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: generate tuples from sequence

[Tim Williams]

On 17 Jan 2007 04:50:33 -0800, Will McGugan <[EMAIL PROTECTED]> wrote:
>
> Will McGugan wrote:
>
> > Hi,
> >
> > I'd like a generator that takes a sequence and yields tuples containing
> > n items of the sqeuence, but ignoring the 'odd' items. For example
>
> Forgot to add, for my purposes I will always have a sequence with a
> multiple of n items.

something along the lines of...

>>> [ (x,x+1,x+2) for x in xrange(0,9,3) ]
[(0, 1, 2), (3, 4, 5), (6, 7, 8)]


HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: smtplib question

[Tim Williams]

On 16/01/07, gandalf gold <[EMAIL PROTECTED]> wrote:
>
> Hi everyone,
>
> I was trying out smtplib and found out that I can email to anyone in my
> domain but not to an email address not in the domain. From browsing on the
> web, it seems that this has to do with the configuration of the mail server.
> The mail server in my organization is MS exchange. Obviously I can email to
> any email address from my MS outlook.
>
> What's the easiest way to fix the program?
>
> Thanks.
>
> - gan
>
> import sys, smtplib
> fr = "[EMAIL PROTECTED]"
> to = "[EMAIL PROTECTED]" # will not work
> line = "testing"
> subj = "subject line"
> msg = "From: %s\r\nTo: %s\r\nSubject: %s\r\n\r\n%s" % (fr, to, subj, line)
> server = smtplib.SMTP("EXCHCLUSTER.ccis.edu")
> server.set_debuglevel(1)
> server.sendmail(fr, [to], msg)
> server.quit()
>

You will need to get smtplib to authenticate when connecting to the
exchange server.Use the login function and the same username/pw
that you use to login to Outlook.

server.login(user, password)

Note: Your exchange administrator may have disabled this function.  (
Your Outlook will almost certainly be using MAPI not SMTP to talk to
the server).

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Python web app. (advice sought)

[Tim Williams]

On 16/01/07, Ralf Schönian <[EMAIL PROTECTED]> wrote:

>
> I would also like to vote for Karrigell.
>
> BTW: Does anyone knows how to avoid stopping/starting of the webserver
> after changing external libraries? I have some own modules under
> /opt/local/python/lib and import them by extending the path with
> sys.path.append() After changing any file here, I have to restart
> Karrigell.
>

Ralf,  you should ask this on the Karrigell list  :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Python web app. (advice sought)

[Tim Williams]

On 15 Jan 2007 00:52:33 -0800, Torabisu <[EMAIL PROTECTED]> wrote:
>
> Duncan Smith wrote:
> > Hello,
> >  I find myself in the, for me, unusual (and at the moment unique)
> > position of having to write a web application.  I have quite a lot of
> > existing Python code that will form part of the business logic.  This
> > relies on 3rd party libraries (such as numpy) which would make porting
> > to e.g. IronPython difficult (I would imagine).  I was thinking LAMP
> > (the P standing for Python, of course), particularly as I was originally
> > encouraged to go for open source solutions.
> >
> > The application will provide some basic statistical analyses of data
> > contained in database tables and associated plots (R / matplotlib /
> > graphviz).  There will also be some heavier duty Monte Carlo simulation
> > and graphical modelling / MCMC.  The user(s) will need to be able to set
> > model parameters; maybe even tinker with model structure, so it will be
> > very interactive (AJAX?).
> >
> > I've had a look at Django, Turbogears and Plone, and at the moment I am
> > torn between Turbogears and Plone.  I get the impression that Turbogears
> > will require me to write more non-Python code, but maybe Plone is more
> > than I need (steeper learning curve?).  Maybe Turbogears will lead to a
> > more loosely coupled app. than Plone?
> >
> > The disconcerting thing is that others on the project (who won't be
> > developing) have started to talk about a LAMP back end with an IIS front
> > end, .NET, and the benefits of sharepoint.  The emphasis is supposed to
> > be on rapid development, and these technologies are supposed to help.
> > But I have no real familiarity with them at all; just Python, C and SQL
> > to any realistic level of competence.
> >
> > Any advice would be greatly appreciated.  I have to do much of the
> > statistical work too, so I need to make good choices (and hopefully be
> > able to justify them so nobody else on the project makes inappropriate
> > choices for me).  e.g. I don't mind learning Javascript if it doesn't
> > take too long.  The physical server will initially be a multiprocessor
> > machine with several GB of RAM.  But we also have a cluster (I have no
> > details, I only started the project a week ago).  So any advice
> > regarding parallelisation would also be appreciated (or, in fact, any
> > useful advice / pointers at all).  Thanks.
> >
> > Duncan
>
> I was in a similar boat a while back, needing to make a decision on
> what to use for our web development.  I had worked with Plone
> previously and found that for our needs it wasn't going to work.  Our
> web development was quite specific and didn't fit ideally into the
> standard content management realm.  I also looked at Django and
> TurboGears, installing and working with each.  I eventually went with
> Django, and I've really enjoyed working with it.  Was a personal choice
> and I'm sure our development would have been as successful if I'd
> chosen TurboGears.
>
> If you want the strength of persistent layers, MVC, templating etc etc
> but want to stay away from the heavier frameworks, another possibility
> is http://webpy.org/.  Very simple to implement, lightweight yet still
> fairly full of features.
>

Don't overlook Karrigell either,  with a tiny learning curve its
always worth consideration, especially if you need rapid development
and a web server that will sit on top of your exising .py modules.

www.karrigell.com

hth :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: WMI Python, writing remotely and retrieving env variables values

[Tim Williams]

On 13 Jan 2007 02:01:11 -0800, Tim Golden <[EMAIL PROTECTED]> wrote:
> Thierry Lam wrote:
> > I'm using the WMI library for python and I was able to connect to
> > another computer on the network with the following line:
> >
> > c = wmi.WMI(computer="the-network-computer", user="hello",
> > password="hello")
> >
> > Is there a way to write information to a file on that computer?
> >
> > How do I read environment variables, for example SystemDrive?
>
> Questions of this sort are really Win32 questions rather than Python
> questions. That's not to say we can't help, but rather that you can
> probably find an answer by going to a search engine of your choice
> and typing in, say, "WMI SystemDrive". I did that, and the first hit
> (from Google) was:
>
> http://msdn2.microsoft.com/en-us/library/aa394239.aspx
>
> which indicates that it's available from the Win32_OperatingSystem
> WMI class. So, in Python:
>
> 
> import wmi
> c = wmi.WMI () # optionally on another computer
> for os in c.Win32_OperatingSystem ():
>   print os # show the whole thing
>   print os.SystemDrive # get only what you want
>
> 
>
> If you were after Environment Variables, then search again,
> this time for "WMI Environment Variables". Third hit:
>
> http://msdn2.microsoft.com/en-us/library/aa394143.aspx
>
> pointing to the Win32_Environment class. And so on.
>
> Your first question: can I write into a file? is a little
> more tricky. As far as I know, there's no way even to
> *create* a file with WMI, let alone write information into
> it. It's not really a file-manipulation technology. You can
> get hold of the name of a remote file and other of its
> properties via the CIM_DataFile class, but you'd have
> to translate that into an accessible UNC to be able to
> access it.
>

One possibility is to create a hidden share on the remote computer and
write to a file on it.

Shares ending in $ are hidden,the unc path would be \\machinename\share$

According to http://msdn2.microsoft.com/en-us/library/aa394594.aspx
you need the WMI Win32_Share class and the Create method.

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: parsing a file name

[Tim Williams]

On 12 Jan 2007 09:16:51 -0800, CSUIDL PROGRAMMEr <[EMAIL PROTECTED]> wrote:
> I have a filename
> cairo-2.3.4.src.rpm
> Is there any way i can only get 2.3.4 from this file name

Is this a one off,  or do you have to process multiple files with similar names?


-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: recursive function

[Tim Williams]

On 8 Jan 2007 16:03:53 +0100, Neil Cerutti <[EMAIL PROTECTED]> wrote:

>
> len(dict.keys()).
>

Or

len(dict)

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Comparing files in a zip to files on drive

[Tim Williams]

On 28 Dec 2006 18:35:15 -0800, kj7ny <[EMAIL PROTECTED]> wrote:
> I am attempting to incrementally back up files using python.  How can I
> compare a file on a hard drive to a file in a python created zip file
> to tell if the file has changed?  Or should I be using some other
> method to determine if a file has changed?

If you are running on an extended FAT or an NTFS filesytem you can
utilise a file's archive attribute. It is set when a file is opened
for modifying.

See the following description of how a backup product describes the process

http://www.grigsoft.com/wndsync/help/sources/abit.htm



-- 

Tim Williams
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: win32 service

[Tim Williams]

On 16/12/06, g.franzkowiak <[EMAIL PROTECTED]> wrote:
> Hi everybody,
>
> have a little problem with a service on Win32.
>
> I use a TCP server as service, but can't access from an other machine.
> Only local access is possible.
>
> The service starts like this:
>
> -> myService.py --username user --password password install <-
>
> followed by start
>
> The user is member in "Log on as service", but... only local access :-(
>
> What is wrong or what can I do ?
>

Have you checked that your firewall isn't causing the problem,  and
that the servers IP address is accessible from other machines to start
with ?
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: parsing a dictionary from a string

[Tim Williams]

On 15/12/06, Benjamin Georgi <[EMAIL PROTECTED]> wrote:
> Hello list,
>
> I could use some help extracting the keys/values of a list of
> dictionaries from a string that is just the str() representation of the
> list (the problem is related to some flat file format I'm using for file
> IO).
>
> Example:
>  >>> s = str(dict_list)
>  >>> s
> '[{0: [2], 1: []}, {0: [], 1: [], 2: []}, {0: [1, 2]}]'
>
> Then, what I want to do is to reconstruct dict_list given s.
> Now, one possible solution would be
>
>  >>> dict_list = eval(s)
>
> but since the content of s cannot be blindly trusted I`d rather not do
> it that way. Basically my question is whether there is another solution
> which is simpler than using regular expressions.


I'm sure I'll get flamed for the following !!  LOL

You could check that the string contains at least part of what you are
expecting.

if  s[0] == '[' :dict_list = eval(s)

or
if  s[:2] == '[{' :   dict_list = eval(s)
if  s[:2] == '[{' and  s[-2:] == '}]' :  dict_list = eval(s)
etc

I doubt it is perfect,  but it is quick and simple and much safer than
a straight eval()

*or*

try:
dict_list = [eval(x+'}') for x in
s.replace('[{','{').replace('}]','').split('},')]
except:
print "file may be compromised"
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: "10, 20, 30" to [10, 20, 30]

[Tim Williams]

On 23/11/06, Fredrik Lundh <[EMAIL PROTECTED]> wrote:
> Tim Williams wrote:
> >>>>
>
> and the use of a list comprehension is pretty silly to, given that you want
> to apply the same *function* to all items, and don't really need to look
> it up for every item:
>
> map(int,  s.split(','))

Haha, thanks Frederic,  I wondered how long it would take for a reply
from you :)

"Silly" though ??

Tim :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: socket.error connection refused

[Tim Williams]

On 23 Nov 2006 04:09:18 -0800, Vania <[EMAIL PROTECTED]> wrote:
> Hi, I'm not sure this is the proper forum but I try nevertheless.
> The problem I'am facing is that the socket library always fail to
> connect to an URL. The net effect is that I can not use setuptools.
> I'm using Python2.4 on a windows XPPRO Sp2 machine.
> The firewall is disabled.
> There is no NLTM proxy.
> I connect to the internet through a NAT server (and it works).
> Other than with easy_install I tried to connect to a number of external
> urls
> (all of them running) and even to localhost,
> directly in script using urllib
> and the error is always the same errno:  10061 connection refused.
> Any ideas?

A socket can't connect to a URL, a URL is an absolute location of an
internet resource, eg hostname + (virtual) location on a server + page
name.  A socket can connect to an IP address or hostname - which is
the first part of the URL after the "http://";  (or ftp:// etc)

You need to post a code snippet and the errors you are getting.
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: "10, 20, 30" to [10, 20, 30]

[Tim Williams]

On 23/11/06, Steven D'Aprano <[EMAIL PROTECTED]> wrote:
> On Thu, 23 Nov 2006 03:13:10 -0800, Daniel Austria wrote:
>
> > Sorry,
> >
> > how can i convert a string like "10, 20, 30" to a list [10, 20, 30]
> >
> > what i can do is:
> >
> > s = "10, 20, 30"
> > tmp = '[' + s + ']'
> > l = eval(tmp)
> >
> > but in my opinion this is not a nice solution
>
>
> It is a dangerous solution if your data is coming from an untrusted source.
>
> >>> s = "10, 20, 30"
> >>> L = [x.strip() for x in s.split(',')]
> >>> L
> ['10', '20', '30']
> >>> L = [int(x) for x in L]
> >>> L
> [10, 20, 30]
>
> Or, as a one liner:  [int(x.strip()) for x in s.split(',')]

You don't need the strip()

>>> int('10 ')
10
>>>

:)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: "10, 20, 30" to [10, 20, 30]

[Tim Williams]

On 23 Nov 2006 03:13:10 -0800, Daniel Austria <[EMAIL PROTECTED]> wrote:
> Sorry,
>
> how can i convert a string like "10, 20, 30" to a list [10, 20, 30]
>
> what i can do is:
>
> s = "10, 20, 30"
> tmp = '[' + s + ']'
> l = eval(tmp)
>
> but in my opinion this is not a nice solution
>

Not nice, especially if you can't control what is in s :)

A simple solution if you know s will always contain string
representations of integers is:

>>> s = "10, 20, 30"
>>> [int(x) for x in s.split(',')]
[10, 20, 30]
>>>

Otherwise a good starting point might be:

>>> for i in s.split(','):

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: string to list of numbers conversion

[Tim Williams]

On 5 Nov 2006 04:34:32 -0800, [EMAIL PROTECTED]
<[EMAIL PROTECTED]> wrote:
> Hi,
>   I have a string '((1,2), (3,4))' and I want to convert this into a
> python tuple of numbers. But I do not want to use eval() because I do
> not want to execute any code in that string and limit it to list of
> numbers.
>   Is there any alternative way?
>

?? I want to convert this into a python tuple of numbers ??

Do you want a python tuple with those numbers ie (1,2, 3,4),  or a
direct evaluation giving a tuple of tuples with those numbers, ie
((1,2), (3,4))

If the former then:

>>> a, l = '((1,2), (3,4), (-5,-6),(12,-13), (a,b), (0.1,0.2))', []
>>> for c in a.split(','):
... try:
... c = c.replace('(','').replace(')','')
... if '.' in c: l.append(float(c))
... else:   l.append(int(c))
... except: pass
...
>>> tuple(l)
(1, 2, 3, 4, -5, -6, 12, -13, 0.10001, 0.20001)
>>>

Its not so good with floats, but if you are only expecting integers you can use.

>>> a, l = '((1,2), (3,4), (-5,-6),(12,-13), (a,b), (0.1,0.2))', []
>>> for c in a.split(','):
... try: l.append(int(c.replace('(','').replace(')','')))
... except: pass
...
>>> tuple(l)
(1, 2, 3, 4, -5, -6, 12, -13)
>>>

HTH :)
-- 
http://mail.python.org/mailman/listinfo/python-list

Re: Getting externally-facing IP address?

[Tim Williams]

On 10/11/06, Tim Williams <[EMAIL PROTECTED]> wrote:
>
>
> On 10/11/06, Michael B. Trausch <[EMAIL PROTECTED]> wrote:
> >
> >
> >
> > Every programming example that I have seen thus far shows simple server
> code and how to bind to a socket--however, every example binds to the
> localhost address.  What I am wondering is this:  Is there a clean way to
> get the networked IP address of the machine the code is running on?  For
> example, my laptop's IP address is 192.168.0.101, and I want to bind a
> server to that address.  Is there a clean way of doing so that will work,
> for example, when I move the code to my server (which obviously doesn't have
> the same IP address)?
> >
> >
>
> Try  using 0.0.0.0  as the IP address,  or possibly giving IP address at
> all.
>
> HTH :)
>
>

Correction:

-> or possibly giving *no* IP address at
-- 
http://mail.python.org/mailman/listinfo/python-list