Hi.

A strange issue: the Frame class doesn't delete the document from the db. Insert and update works fine.

            str_id = '{}_{}_{}_{}_{}'.format(
                data_before.get('CodImpianto'),
                data_before.get('Armadio'),
                data_before.get('DateVar'),
                data_before.get('ShelfEvent'),
                data_before.get('Counter'),
            )
            log_id = sha224(str_id.encode()).hexdigest()
            previous_record = SDClosetLogs().by_id(log_id)

            if previous_record is not None:
                logger.debug('Deleting document {}.'.format(previous_record._id))
                try:
                    # previous_record.delete()
                    SDClosetLogs.delete(SDClosetLogs().by_id(log_id))
                except Exception as e:
                    logger.error('Cannot delete document {}. Error: {}'.format(previous_record._id, e))
                    return False

This is the log: 2016-12-11 16:30:36 DEBUG 3700 spy_replicator.etl_modules.etl_spydoc etl_spydoc.py:219 => Deleting document c4e599fb7467db9f868746631b7daea81a32fc63a2be05871b5710d8. (no exception logged) I tried using both the previous_record instance and the general Frame class.

This is the documents in collections pre and after the delete operation:

This is the Frame class

class SDClosetLogs(Frame):
    _db = 'spy'
    _collection = 'logs'
    _fields = {
        '_id',
        'date',
        'type',
        'subtype',
        'installation',
        'closet',
        'shelf_event',
        'tag_id',
        'tag_user',
        'description',
        'counter'
    }

Hi.

I've created a frameless class as stated here: http://mongoframes.com/snippets/frameless and it works like a charm :)

What about to introduce a check for the defined fields?

Here is an example of my frameless class:

class InfluxMetric(Frameless):
    _collection = 'influxdb_metrics'
    _fields = {
        '_id',
        'test'
    }

Is it possible to force the new class to fill-in at least the two defined fields (_id and test)?

Thanks, Giovanni

Hi.

How to delete/edit SubFrame?

Let me explain. I have these Frames/SubFrames:

class Room(SubFrame):
    _fields = {
        'room_id',
        'name'
    }


class Floor(SubFrame):
    _default_projection = {'rooms': {'$sub': Room}}
    _fields = {
        'floor_id',
        'name',
        'rooms'
    }


class Building(Frame):
    _db = 'spy'
    _collection = 'buildings'
    _default_projection = {'floors': {'$sub': Floor}}
    _fields = {
        '_id',
        'building_id',
        'name',
        'street',
        'city',
        'zipcode',
        'province',
        'state',
        'phone',
        'lat_lon',
        'notes',
        'floors'
    }

Then create the building

building = Building(
    _id='id',
    building_id='building_id',
    name='test',
    city='Milan'
)

Create rooms and floors

room01 = Room(
    name='test room 1',
    room_id=1
)

room02 = Room(
    name='test room 2',
    room_id=2
)

room03 = Room(
    name='test room 3',
    room_id=3
)

room04 = Room(
    name='test room 4',
    room_id=4
)

floor01 = Floor(
    floor_id=1,
    name='First floor',
    rooms=[room01, room02]
)

floor02 = Floor(
    floor_id=2,
    name='Second floor',
    rooms=[room03, room04]
)

building.floors = [floor01, floor02]

Now what if:

1. I want to edit a floor/room with a specific floor_id/room_id
2. I want to delete a floor/room with a specific floor_id/room_id

Thanks

Hi.

I've this document: { "_id" : "report_xyz", "name" : "XYZ.COM", "site24" : { "monitors" : [ NumberLong(27498547952905495), NumberLong(18975984759794899), NumberLong(19875894954998994), NumberLong(14987598437950899), NumberLong(17498574975919809) ] } }

If I try to get it with by_id this is the error: bson.errors.InvalidId: 'report_xyz' is not a valid ObjectId, it must be a 12-byte input or a 24-character hex string

Giovanni

Hi, I notice the guide says, "Projections also allow reference fields (fields containing an ObjectID) to be dereferenced." This implies that a field is a reference to another document if and only if it contains an ObjectId. In fact, a field can contain an ObjectId and not be a reference to another document. Additionally, a field could contain any other type (int, string, subdocument, ...) except array, and yet be a reference to another document.

Documents' _id fields can contain any type but array:

https://docs.mongodb.com/manual/core/document/#the-id-field

Hi.

How can I map a document like this?

{ "_id" : "locations_names", "1" : "California - US", "2" : "New Jersey - US", "3" : "Singapore - SG", "4" : "Texas - US", "5" : "Rotterdam - NL", "6" : "London - UK", "7" : "Dallas - US", "8" : "Seattle - US", "9" : "Chicago - US", "10" : "Cologne - DE", "11" : "Johannesburg - ZA", "12" : "Melbourne - AUS", "13" : "Nagano - JP", "14" : "Shanghai - CHN", "15" : "Chennai - IN", "16" : "Rio de Janeiro - BR", "17" : "Stockholm - SWE", "18" : "Paris - FR", "19" : "Virginia - US", "20" : "Ireland - IE", "21" : "Hong Kong - HK", "22" : "Sao Paulo - BR", "23" : "Barcelona - ES", "24" : "Milano - IT", "25" : "New York - US", "26" : "Los Angeles - US", "27" : "Denver - US", "28" : "Kansas - US", "29" : "Munich - DE", "30" : "Washington - US", "31" : "Montreal - CA", "32" : "Phoenix - US", "33" : "Mumbai - IN", "34" : "Istanbul - TR", "35" : "Tel Aviv - IL", "36" : "Sydney - AUS", "37" : "Auckland - NZ", "38" : "Atlanta - US", "39" : "Brussels - BE", "40" : "Toronto - CA", "41" : "Copenhagen - DA", "42" : "Vienna - AT", "43" : "Zurich - CH", "44" : "Warsaw - PL", "45" : "Bucharest - RO", "46" : "Moscow - RU", "47" : "Beijing - CHN", "48" : "Hangzhou City - CHN", "49" : "Qingdao City - CHN", "50" : "Miami - US", "52" : "Tokyo - JP", "55" : "Dubai - UAE", "56" : "Queretaro - MEX", "57" : "Falkenstein - DE", "58" : "Strasbourg - FR", "59" : "Bengaluru - IN", "source" : "site24" }

The fields name are not static and they can grow in the future.

If in the class I only map the ones that are static class LocationInfo(Frame): _collection = 'locations_info' _fields = { 'source' }

Than I've got only them in the query result {'_document': {'_id': 'locations_names', 'source': 'site24'}}

Thanks

Hi, I had the idea to integrate ctypes/Structure. I imagined that somehow:

1. Get the meta data of the collection (field -> type)
2. Build a object template by mongodb -> ctypes mapping definition
3. Use the ctypes object template to construct the objects

I've already started my own experiment and I have to say that the performance gain is enormous:

class Attribute(Frame):
    __metaclass__ = ctypes.Structure
    _collection = 'system_attribute'
    _fields = {
        'key',
        'label',
        'description',
        'metadata',
        'field_class',
        'multivalue',
        'tags',
    }

    _fields_ = [
        ('key', ctypes.c_char),
        ('label', ctypes.c_char),
        ('description', ctypes.c_char),
        ('field_class', ctypes.c_char),
        ('multivalue', ctypes.c_bool),
        ('tags', ctypes.Union),
    ]

Let me know what you think

At the moment to specify the order of a set of results we'd do something like:

articles = Ariticle.many(sort=[('publish_date', DESC), ('title', ASC)])

I think it would be a useful addition to the query builder if we would instead build these sort lists along the lines that we build queries, e.g:

articles = Ariticle.many(sort=[Q.publish_date.desc, Q.title])

GetmeUK/MongoFrames now has a Chat Room on Gitter

@anthonyjb has just created a chat room. You can visit it here: https://gitter.im/GetmeUK/MongoFrames.

This pull-request adds this badge to your README.md:

If my aim is a little off, please let me know.

Happy chatting.

PS: Click here if you would prefer not to receive automatic pull-requests from Gitter in future.

The Blueprint class triggers fake and faked events against Frame instances inconsistently with the way that other Frame methods trigger events.

The work around currently is to use a classmethod (to receive the sender) over using a staticmethod. Fixing this issue will break backwards compatibility so I look into a solution that can cater for both in the short term (it's a pretty simple fix to upgrade, however, switch classmethods to staticmethods).

Note This bug doesn't not affect documented functionality.

Hi. It would be great if MongoFrame implements also a check of field type/structure.

Let me say I want to have all the documents of a certain type with the same _id structure:

class Test(Frame):
    _db = 'testdb'
    _collection = 'testcollection'
    _fields = {
        '_id': {
            'template': 'test_id_'
            'type': str
        },

so when I create a new Test class, i could do the following:

Test(_id=1234).insert()

and the result _id will be "test_id_1234"

In this way it's more simple also to document the structure of the document.

Let me know if this could be in the philosophy of MongoFrames or it's better to use an external validator. In the latter case, any advice?

Thanks