Revisions to Populating 2 columns in a dataframe with frequencies from a dictionary of dataframes

Post Undeleted by Reinderien

occurred Dec 21, 2024 at 14:05

added 605 characters in body

Source Link

edited Dec 21, 2024 at 14:04

71.2k
5
76
257

AlignYou should align to this indexa multi-index with no nested loops:

import pandas as pd

freq_df = pd.DataFrame(
    index=pd.MultiIndex.from_arrays(
        arrays=(
            ('freqset1', 'freqset1', 'freqset1'),
            (0, 1, 2),
        ),
        names=('freqset', 'id'),
    ),
    data={
        'Address': ('Box 1', 'Box 2', 'Box n'),
        'New York': (0.24560, 0.00100, 0.45450),
        'Buffalo': (0.95000, 0.45190, 0.20341),
        'Miami': (0.25000, 0.65091, 0.11110),
    },
)

names = ['Jeff', 'Jenn', 'Leroy']

locations = [
    'New York', 'Buffalo', 'Miami', 'Tampa', 'Boston',
    'Pittsburgh', 'Portland', 'Seattle', 'Toronto',
    'Witchita', 'Austin', 'Bangor', 'Charleston',
]

freqsets = [
    'freqset1','freqset2','freqset3','freqset4',
    'freqset5','freqset6','freqset7','freqset8',
    'freqset9','freqset10','freqset11','freqset12',
]

formulas = [
    'form1', 'form2', 'form3', 'form4', 'form5',
    'form6', 'form7', 'form8', 'form9', 'form10',
    'form11', 'form12', 'form13', 'form14',
]

cartesian = pd.MultiIndex.from_product(
    iterables=(names, locations, freqsets, formulas)),
print    names=(cartesian'name', 'location', 'freqset', 'formula'),
)

The multi-index looks like

I can't suggest anything elseget any further into a review because you haven't shownyour code is non-reproducible; freq_dictAddress1 and Address2 values are unclear.

Align to this index:

import pandas as pd

names = ['Jeff', 'Jenn', 'Leroy']

locations = [
    'New York', 'Buffalo', 'Miami', 'Tampa', 'Boston',
    'Pittsburgh', 'Portland', 'Seattle', 'Toronto',
    'Witchita', 'Austin', 'Bangor', 'Charleston',
]

freqsets = [
    'freqset1','freqset2','freqset3','freqset4',
    'freqset5','freqset6','freqset7','freqset8',
    'freqset9','freqset10','freqset11','freqset12',
]

formulas = [
    'form1', 'form2', 'form3', 'form4', 'form5',
    'form6', 'form7', 'form8', 'form9', 'form10',
    'form11', 'form12', 'form13', 'form14',
]

cartesian = pd.MultiIndex.from_product((names, locations, freqsets, formulas))
print(cartesian)

I can't suggest anything else because you haven't shown freq_dict.

You should align to a multi-index with no nested loops:

import pandas as pd

freq_df = pd.DataFrame(
    index=pd.MultiIndex.from_arrays(
        arrays=(
            ('freqset1', 'freqset1', 'freqset1'),
            (0, 1, 2),
        ),
        names=('freqset', 'id'),
    ),
    data={
        'Address': ('Box 1', 'Box 2', 'Box n'),
        'New York': (0.24560, 0.00100, 0.45450),
        'Buffalo': (0.95000, 0.45190, 0.20341),
        'Miami': (0.25000, 0.65091, 0.11110),
    },
)

names = ['Jeff', 'Jenn', 'Leroy']

locations = [
    'New York', 'Buffalo', 'Miami', 'Tampa', 'Boston',
    'Pittsburgh', 'Portland', 'Seattle', 'Toronto',
    'Witchita', 'Austin', 'Bangor', 'Charleston',
]

freqsets = [
    'freqset1','freqset2','freqset3','freqset4',
    'freqset5','freqset6','freqset7','freqset8',
    'freqset9','freqset10','freqset11','freqset12',
]

formulas = [
    'form1', 'form2', 'form3', 'form4', 'form5',
    'form6', 'form7', 'form8', 'form9', 'form10',
    'form11', 'form12', 'form13', 'form14',
]

cartesian = pd.MultiIndex.from_product(
    iterables=(names, locations, freqsets, formulas),
    names=('name', 'location', 'freqset', 'formula'),
)

The multi-index looks like

I can't get any further into a review because your code is non-reproducible; Address1 and Address2 values are unclear.

Post Deleted by Reinderien

occurred Dec 20, 2024 at 13:19

Source Link

answered Dec 20, 2024 at 13:18

Reinderien

71.2k
5
76
257

Align to this index:

import pandas as pd

names = ['Jeff', 'Jenn', 'Leroy']

locations = [
    'New York', 'Buffalo', 'Miami', 'Tampa', 'Boston',
    'Pittsburgh', 'Portland', 'Seattle', 'Toronto',
    'Witchita', 'Austin', 'Bangor', 'Charleston',
]

freqsets = [
    'freqset1','freqset2','freqset3','freqset4',
    'freqset5','freqset6','freqset7','freqset8',
    'freqset9','freqset10','freqset11','freqset12',
]

formulas = [
    'form1', 'form2', 'form3', 'form4', 'form5',
    'form6', 'form7', 'form8', 'form9', 'form10',
    'form11', 'form12', 'form13', 'form14',
]

cartesian = pd.MultiIndex.from_product((names, locations, freqsets, formulas))
print(cartesian)

MultiIndex([( 'Jeff',   'New York',  'freqset1',  'form1'),
            ( 'Jeff',   'New York',  'freqset1',  'form2'),
            ( 'Jeff',   'New York',  'freqset1',  'form3'),
            ( 'Jeff',   'New York',  'freqset1',  'form4'),
            ( 'Jeff',   'New York',  'freqset1',  'form5'),
            ( 'Jeff',   'New York',  'freqset1',  'form6'),
            ( 'Jeff',   'New York',  'freqset1',  'form7'),
            ( 'Jeff',   'New York',  'freqset1',  'form8'),
            ( 'Jeff',   'New York',  'freqset1',  'form9'),
            ( 'Jeff',   'New York',  'freqset1', 'form10'),
            ...
            ('Leroy', 'Charleston', 'freqset12',  'form5'),
            ('Leroy', 'Charleston', 'freqset12',  'form6'),
            ('Leroy', 'Charleston', 'freqset12',  'form7'),
            ('Leroy', 'Charleston', 'freqset12',  'form8'),
            ('Leroy', 'Charleston', 'freqset12',  'form9'),
            ('Leroy', 'Charleston', 'freqset12', 'form10'),
            ('Leroy', 'Charleston', 'freqset12', 'form11'),
            ('Leroy', 'Charleston', 'freqset12', 'form12'),
            ('Leroy', 'Charleston', 'freqset12', 'form13'),
            ('Leroy', 'Charleston', 'freqset12', 'form14')],
           length=6552)

I can't suggest anything else because you haven't shown freq_dict.

Stack Exchange Network

Return to Answer