Java Jester

Monday, November 10, 2008

Custom Python Decorator

Decorators allow developers to use aspect oriented approach. Here is an example of a custom python/django decorator that checks if the user is a super user and redirects it to login page if not

def super_user(func):
    def call(request, *args, **kwds):
        user = request.user
        if user.is_authenticated() and user.is_superuser:
            return func(request, *args, **kwds)
        else:
            return utils.redirect(settings.LOGIN_URL)
    return call
Here is an example usage:
@super_user
def my_view(request):
    pass

 

Saturday, November 08, 2008

Django Tip: Cache List instead of QuerySet to minimize queries to the database

While playing with django debug toolbar, I noticed that some page on my application causes serious amount of queries that is being executed. One page actually executes around 580 queries so I investigated and noticed that this was caused probably by lazy initialization, not using select_related() on my queries and i'm caching QuerySet object instead of list.

An example of a getter function on my model:

@property
    def data(self):
        cache_data = getattr(self, 'cache_data', None)
        if cache_data:
            return cache_data
        else:
            self.cache_data = TimecardData.objects.filter(timecard_day=self)
            return self.cache_data

The code above retrieves all the associated data on my timecard but to prevent it from hitting the database everytime i call that data() method, i need to cache it. One mistake I did is to cache the returned query set instead of casting it to a list type because whenever the cache_data is retrieved, It will again hit the database since it's only a query set.

After refactoring the above code to this one:
@property
    def data(self):
        cache_data = getattr(self, 'cache_data', None)
        if cache_data:
            return cache_data
        else:
            self.cache_data = list(TimecardData.objects.select_related()
.filter(timecard_day=self))
            return self.cache_data
The queries was reduced from 560 to 300 queries.

Further looking at the problem, I refactored the code to this one:

I still have a long way debugging the problem but I hope this helps you aswell.
@property
    def data(self):
        cache_data = getattr(self, 'cache_data', None)
        if cache_data != None:
            return cache_data
        else:
            self.cache_data = list(TimecardData.objects.select_related().filter(timecard_day=self))
            return self.cache_data
The code above to this one checks using "if cache_data" but since empty list returns false if evaluated, it queries the database again instead of using cache. This one brought the queries from 580 to 120 (a very big difference)

 

Tuesday, November 04, 2008

Python 2.5 Date/Time Module Poorly Designed?

I'm not sure If I'm the only one who feel that the date/time module in python 2.5 is very hard to use. If any of you ever tried using joda time, you'll notice that it's way to easy compared to python's date/time library.

Correct me If i'm wrong but joda time was created by Google guys so I hope that in the near future, python will have a better date/time library (since Google is the main supporter of python).

 

Saturday, November 01, 2008

Profiling Django Applications

While working on one of my projects today, I noticed that the page loads slow. And the thing that helped me debug the problem was a tool called django toolbar. It's a django application that displays the time of request, the queries that were executed, cache and other information that you can use to optimize your application.

 

Wednesday, October 29, 2008

Site Moving To App Engine


I've been working hard to move my blog site to app engine platform. It will take me a couple more days to complete it so I won't be blogging about anything for a while

 


recommended books
Jester Cap Logo by Vonn reyjexter.com | Valid XHTML & CSS | 2008 | Design & Devt. by: vonnhugo

powered by:

django framework python google app engine